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Series Preface 


Mathematics is playing an ever more important role in the physical and 
biological sciences, provoking a blurring of boundaries between scientific 
disciplines and a resurgence of interest in the modern as well as the clas- 
sical techniques of applied mathematics. This renewal of interest, both in 
research and teaching, has led to the establishment of the series: Texts in 
Applied Mathematics (TAM). 

The development of new courses is a natural consequence of a high level of 
excitement on the research frontier as newer techniques, such as numerical 
and symbolic computer systems, dynamical systems, and chaos, mix with 
and reinforce the traditional methods of applied mathematics. Thus, the 
purpose of this textbook series is to meet the current and future needs of 
these advances and encourage the teaching of new courses. 

TAM will publish textbooks suitable for use in advanced undergraduate 
and beginning graduate courses, and will complement the Applied Math- 
ematical Sciences (AMS) series, which will focus on advanced textbooks 
and research level monographs. 


Pasadena, California J.E. Marsden 
Providence, Rhode Island L. Sirovich 
Houston, Texas M. Golubitsky 


Preface to the Third Edition 


This book covers those topics necessary for a clear understanding of the 
qualitative theory of ordinary differential equations and the concept of 
a dynamical system. It is written for advanced undergraduates and for 
beginning graduate students. It begins with a study of linear systems of 
ordinary differential equations, a topic already familiar to the student who 
has completed a first course in differential equations. An efficient method 
for solving any linear system of ordinary differential equations is presented 
in Chapter 1. 

The major part of this book is devoted to a study of nonlinear sys- 
tems of ordinary differential equations and dynamical systems. Since most 
nonlinear differentia] equations cannot be solved, this book focuses on the 
qualitative or geometrical theory of nonlinear systems of differential equa- 
tions originated by Henri Poincaré in his work on differential equations at 
the end of the nineteenth century as well as on the functional properties 
inherent in the solution set of a system of nonlinear differential equations 
embodied in the more recent concept of a dynamical system. Our primary 
goal is to describe the qualitative behavior of the solution set of a given 
system of differential equations including the invariant sects and limiting 
behavior of the dynamical system or flow defined by the system of dif- 
ferential equations. In order to achieve this goal, it is first necessary to 
develop the local theory for nonlinear systems. This is done in Chapter 2 
which includes the fundamental local existence—uniqueness theorem, the 
Hartman-—Grobman Theorem and the Stable Manifold Theorem. These lat- 
ter two theorems establish that the qualitative behavior of the solution set 
of a nonlinear system of ordinary differential equations near an equilibrium 
point is typically the same as the qualitative behavior of the solution set 
of the corresponding linearized system near the equilibrium point. 

After developing the local theory, we turn to the global theory in Chap- 
ter 3. This includes a study of limit sets of trajectories and the behavior of 
trajectories at infinity. Some unresolved problems of current research inter- 
est are also presented in Chapter 3. For example, the Poincaré-Bendixson 
Theorem, established in Chapter 3, describes the limit sets of trajectories 
of two-dimensional systems; however, the limit sets of trajectories of three- 
dimensional (and higher dimensional) systems can be much more compli- 
cated and establishing the nature of these limit sets is a topic of current 
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research interest in mathematics. In particular, higher dimensional systems 
can exhibit strange attractors and chaotic dynamics. All of the preliminary 
material necessary for studying these ore advance topics is contained in 
this textbook. This book can therefore serve as a springboard for those stu- 
dents interested in continuing their study of ordinary differential equations 
and dynamical systems and doing research in these areas. Chapter 3 ends 
with a technique for constructing the global phase portrait of a dynami- 
cal system. The global phase portrait describes the qualitative behavior of 
the solution set for all time. In general, this is as close as we can come to 
“solving” nonlinear systems. 

In Chapter 4, we study systems of differential equations depending on pa- 
rameters. The question of particular interest is: For what parameter values 
does the global phase portrait of a dynamical system change its qualitative 
structure? The answer to this question forms the subject matter of bifurca- 
tion theory. An introduction to bifurcation theory is presented in Chapter 
4 where we discuss bifurcations at nonhyperbolic equilibrium points and 
periodic orbits as well as Hopf bifurcations. Chapter 4 ends with a dis- 
cussion of homoclinic loop and Takens-Bogdanov bifurcations for planar 
systems and an introduction to tangential homoclinic bifurcations and the 
resulting chaotic dynamics that can occur in higher dimensional systems. 

The prerequisites for studying differential equations and dynamical sys- 
tems using this book are courscs in linear algebra and real analysis. For 
example, the student should know how to find the cigenvalues and cigenvec- 
tors of a linear transformation represented by a square matrix and should 
be familiar with the notion of uniform convergence and related concepts. In 
using this book, the author hopes that the student will develop an appre- 
ciation for just how useful the concepts of linear algebra, real analysis and 
geometry are in developing the theory of ordinary differential equations 
and dynamical systems. The heart of the geometrical theory of nonlinear 
differential equations is contained in Chapters 2-4 of this book and in or- 
der to cover the main ideas in those chapters in a one semester course, it 
is necessary to cover Chapter 1 as quickly as possible. 

In addition to the new sections on center manifold and normal form 
theory, higher codimension bifurcations, higher order Melnikov theory, the 
Takens—Bogdanov bifurcation and bounded quadratic systems in R? that 
were added to the second edition of this book, the third edition contains 
two new sections, Section 4.12 on Francoise’s algorithm for higher order 
Melnikov functions and Section 4.15 on the higher codimension bifurcations 
that occur in the class of bounded quadratic systems. Also, some new results 
on the structural stability of polynomial systems on R? have been added 
at the end of Section 4.1, some recent results for determining the order of 
a weak focus of a planar quadratic system have been added at the end of 
Section 4.4, and several new problems have been interspersed throughout 
the book. 
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A solutions manual for this book has been prepared by the author and is 
now available under separate cover from Springer-Verlag at no additional 
cost. 

I would like to express my sincere appreciation to my colleagues Freddy 
Dumortier, Iliya Iliey, Doug Shafer and especially to Terence Blows and 
Jim Swift for their many helpful suggestions which substantially improved 
this book. I would also like to thank Louella Holter for her patience and 
precision in typing the original manuscript for this book. 


Flagstaff, Arizona Lawrence Perko 
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Linear Systems 


This chapter presents a study of linear systems of ordinary differential 
equations: 


x = Ax (1) 
where x € R",A is ann x n matrix and 

dry 

dt 

pe 2 

~ at 
drm 

dt 


It is shown that the solution of the linear system (1) together with the 
initial condition x(0) = xo is given by 
x(t) = e4'x, 


where e“* is an n x n matrix function defined by its Taylor series. A good 
portion of this chapter is concerned with the computation of the matrix 
e“* in terms of the eigenvalues and eigenvectors of the square matrix A. 
Throughout this book all vectors will be written as column vectors and A? 
will denote the transpose of the matrix A. 


1.1 Uncoupled Linear Systems 


The method of separation of variables can be used to solve the first-order 
linear differential equation 
z= az. 


The general solution is given by 
x(t) = ce™ 


where the constant c = z(0), the value of the function z(t) at time t = 0. 
Now consider the uncoupled linear system 


ZL) =-T) 
r2 = 222. 
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This system can be written in matrix form as 


x = Ax (1) 


—-1 0 
de ; | | 
Note that in this case A is a diagonal matrix, A = diag[—1, 2], and in general 
whenever A is a diagonal matrix, the system (1) reduces to an uncoupled 
linear system. The general solution of the above uncoupled linear system 


can once again be found by the method of separation of variables. It is 
given by 


where 


z(t) = ce! 
Z(t) = cye* (2) 
or equivalently by 
e* 0 ; 
x()=] 9) 2} ¢ (2’) 


where c = x(0). Note that the solution curves (2) lie on the algebraic 
curves y = k/x? where the constant k = c?c2. The solution (2) or (2’) 
defines a motion along these curves; i.e., each point c € R? moves to the 
point x(t) € R? given by (2’) after time t. This motion can be described 
geometrically by drawing the solution curves (2) in the x;, r2 plane, referred 
to as the phase plane, and by using arrows to indicate the direction of 
the motion along these curves with increasing time t; cf. Figure 1. For 
C) = Co = 0, x) (t) = O and z2(t) = 0 for all t € R and the origin is referred 
to as an equilibrium point in this example. Note that solutions starting on 
the z)-axis approach the origin as t — oo and that solutions starting on 
the r2-axis approach the origin as t + —oo. 

The phase portrait of a system of differential equations such as (1) with 
x € R” is the set of all solution curves of (1) in the phase space R”. Figure 1 
gives a geometrical representation of the phase portrait of the uncoupled 
linear system considered above. The dynamical system defined by the linear 
system (1) in this example is simply the mapping ¢: R x R? — R? defined 
by the solution x(t,c) given by (2’); i.e., the dynamical system for this 
example is given by 

e* 0 
P(t,c) = | F nl Cc. 

Geometrically, the dynamical system describes the motion of the points in 
phase space along the solution curves defined by the system of differential 
equations. 

The function 

f(x) = Ax 

on the right-hand side of (1) defines a mapping f: R? — R? (linear in this 
case). This mapping (which need not be linear) defines a vector field on 
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X2 


Figure 1 


R?; i.e., to each point x € R?, the mapping f assigns a vector f(x). If we 
draw each vector f(x) with its initial point at the point x € R?, we obtain 
a geometrical representation of the vector field as shown in Figure 2. Note 
that at each point x in the phase space R?, the solution curves (2) are 
tangent to the vectors in the vector field Ax. This follows since at time 
t = to, the velocity vector vo = x(to) is tangent to the curve x = x(t) at 
the point x9 = x(to) and since x = Ax along the solution curves. 
Consider the following uncoupled linear system in R?: 


Z) = 2 
r2 = 22 (3) 
rg = —Z3 


4 1. Linear Systems 


The general solution is given by 


z(t) = c,e' 
ro(t) = coe’ 
£3(t) = c3e. 


And the phase portrait for this system is shown in Figure 3 above. The 
£,22 plane is referred to as the unstable subspace of the system (3) and 
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the x3 axis is called the stable subspace of the system (3). Precise definitions 
of the stable and unstable subspaces of a linear system will be given in the 
next section. 


PROBLEM SET 1 


1. Find the general solution and draw the phase portrait for the follow- 
ing linear systems: 


(0) oa 
Cee 
Cea 

@ an 

(e) es : am = 


Hint: Write (d) as a second-order linear differential equation with 
constant coefficients, solve it by standard methods, and note that 2? + 
x2 = constant on the solution curves. In (e), find r2(t) = cge~* and 


then the x,-equation becomes a first order linear differential equation. 


2. Find the general solution and draw the phase portraits for the fol- 
lowing three-dimensional linear systems: 


Q) = 2 
(a) t2 = 22 
r3 = 23 
I) = —-Z 
(b) zo = —z2 
r3 = 73 
zy) = -—-Z2 
(c) Zr =T}) 
r3 = —I3 


Hint: In (c), show that the solution curves lie on right circular cylin- 
ders perpendicular to the z;, 22 plane. Identify the stable and unsta- 
ble subspaces in (a) and (b). The z3-axis is the stable subspace in (c) 
and the x),22 plane is called the center subspace in (c); cf. Section 
1.9. 


6. 
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. Find the general solution of the linear system 


Z}=2 
r2 = az2 
where a is a constant. Sketch the phase portraits for a = —l1,a = 0 


and a = 1 and notice that the qualitative structure of the phase 
portrait is the same for all a < 0 as well as for all a > 0, but that it 
changes at the parameter value a = 0 called a bifurcation value. 


. Find the general solution of the linear system (1) when A is the 


n x n diagonal matrix A = diag[A;, A2,...,An]. What condition on 
the eigenvalues A1,...,An will guarantee that lim;_... x(t) = 0 for all 
solutions x(t) of (1)? 


. What is the relationship between the vector fields defined by 


x = Ax 
and 
x = kAx 
where k is a non-zero constant? (Describe this relationship both for 
k positive and k negative.) 
(a) If u(t) and v(t) are solutions of the linear system (1), prove that 
for any constants a and 6, w(t) = au(t) + bv(t) is a solution. 
(b) For 


find solutions u(t) and v(t) of x = Ax such that every solution 
is a linear combination of u(t) and v(t). 


1.2 Diagonalization 


The algebraic technique of diagonalizing a square matrix A can be used to 
reduce the linear system 


x = Ax (1) 


to an uncoupled linear system. We first consider the case when A has real, 
distinct eigenvalues. The following theorem from linear algebra then allows 
us to solve the linear system (1). 


Theorem. If the eigenvalues r;,A2,...,An of ann xn matriz A are real 


and distinct, then any set of corresponding eigenvectors {v),V2,...,Vn} 


forms a basis for R", the matrir P = [v1 v2 --: Vn] is invertible and 


P-'AP = diag[\i,..., An]: 
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This theorem says that if a linear transformation T: R” — R” is 
represented by the n x n matrix A with respect to the standard basis 


{e1,e2,...,@n} for R”, then with respect to any basis of eigenvectors 
{v1,V2,-.-;Wn}, I is represented by the diagonal matrix of eigenvalues, 
diag[A;, A2,.-.,;An]. A proof of this theorem can be found, for example, in 


Lowenthal [Lo]. 
In order to reduce the system (1) to an uncoupled linear system using 
the above theorem, define the linear transformation of coordinates 


y = P!x 
where P is the invertible matrix defined in the theorem. Then 
x = Py, 
y = P-'x = P~'Ax = P~'APy 
and, according to the above theorem, we obtain the uncoupled linear system 
y = diag[A,...,An]y. 
This uncoupled linear system has the solution 
y(t) = diag(e™*, ie ,ern*]y(0). 


(Cf. problem 4 in Problem Set 1.) And then since y(0) = P~!x(0) and 
x(t) = Py(t), it follows that (1) has the solution 


x(t) = PE(t)P—'x(0). (2) 
where E(t) is the diagonal matrix 
E(t) = diag[e*"*, see ern), 


Corollary. Under the hypotheses of the above theorem, the solution of the 
linear system (1) is given by the function x(t) defined by (2). 


Example. Consider the linear system 

Zi =-—-21- 322 

LQ = 222 
which can be written in the form (1) with the matrix 

-1 -3 

re ; | | 
The eigenvalues of A are 4; = —1 and Ag = 2. A pair of corresponding 
eigenvectors is given by 
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The matrix P and its inverse are then given by 


_fl -1 ee iE, a 
P=|j and P =lo if 


The student should verify that 


-14p_[-1 0 
ptap=[5 al. 


Then under the coordinate transformation y = P~!x, we obtain the un- 
coupled linear system 


y= -Y1 

Yo = 2y2 
which has the general solution y;(t) = c)e~*, yo(t) = coe”*. The phase por- 
trait for this system is given in Figure 1 in Section 1.1 which is reproduced 
below. And according to the above corollary, the general solution to the 
original linear system of this example is given by 
-t 


x(t) = P F 


0 at 
a Pre 


where c = x(0), or equivalently by 

az, (t) = cye~* + co(e~* — e**) 
at (3) 
L(t) = coe”. 


The phase portrait for the linear system of this example can be found by 
sketching the solution curves defined by (3). It is shown in Figure 2. The 


woke 


Figure 1 Figure 2 


%2 


al | 
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phase portrait in Figure 2 can also be obtained from the phase portrait in 
Figure 1 by applying the linear transformation of coordinates x = Py. Note 
that the subspaces spanned by the eigenvectors v, and v2 of the matrix 
A determine the stable and unstable subspaces of the linear system (1) 
according to the following definition: 

Suppose that the n x n matrix A has k negative eigenvalues \,,..., Ax 
and n — k positive eigenvalues A,41,...,;An and that these eigenvalues are 
distinct. Let {v,,...,Vn} be a corresponding set of eigenvectors. Then the 
stable and unstable subspaces of the linear system (1), E* and E™, are the 
linear subspaces spanned by {v,,...,v%} and {Vx41,---,; Vn} respectively; 
i.e., 


E* = Span{vi,..., Ve} 
E* = Span{vx41,---)Vn}- 


If the matrix A has pure imaginary eigenvalues, then there is also a center 
subspace E‘; cf. Problem 2(c) in Section 1.1. The stable, unstable and 
center subspaces are defined for the general case in Section 1.9. 


PROBLEM SET 2 


1. Find the eigenvalues and eigenvectors of the matrix A and show that 
B = P-'AP is a diagonal matrix. Solve the linear system y = By 
and then solve x = Ax using the above corollary. And then sketch 
the phase portraits in both the x plane and y plane. 


3 1 
(a) A= i 4 
1 3 
o) A= [3 4] 
-1 1 
(c) A= 1 a . 
2. Find the eigenvalues and eigenvectors for the matrix A, solve the 


linear system x = Ax, determine the stable and unstable subspaces 
for the linear system, and sketch the phase portrait for 


10 0 
x=/1 2 O| x. 
10 -1l 


3. Write the following linear differential equations with constant coeffi- 
cients in the form of the linear system (1) and solve: 


(a) £+z2-—2r=0 
(b) £+z2=0 


10 
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(c) f-2z --z+22r=0 


Hint: Let x); = 7,22 = 4), etc. 


. Using the corollary of this section solve the initial value problem 


x = Ax 
x(0) = Xo 
(a) with A given by 1(a) above and xo = (1, 2)7 
(b) with A given in problem 2 above and Xo = (1, 2,3)7. 


. Let the nxn matrix A have real, distinct eigenvalues. Find conditions 


on the eigenvalues that are necessary and sufficient for lim;... x(t) = 
O where x(t) is any solution of x = Ax. 


. Let the n x n matrix A have real, distinct eigenvalues. Let $(t, xo) 


be the solution of the initial value problem 
x = Ax 
x(0) = Xp. 
Show that for each fixed t € R, 
eile H(t, Yo) = P(t, Xo). 


This shows that the solution (t,x) is a continuous function of the 
initial condition. 


. Let the 2x2 matrix A have real, distinct eigenvalues A and y.. Suppose 


that an eigenvector of \ is (1,0)7 and an eigenvector of yz is (—1,1)7. 
Sketch the phase portraits of x = Ax for the following cases: 

(a) O<A<p (b) O<p<A (c) A<p<O0 

(d) A\<O<p (e) p< O0<A (f) A=0,p>0. 


1.3. Exponentials of Operators 


In order to define the exponential of a linear operator T: R" — R”, it is 
necessary to define the concept of convergence in the linear space L(R”) of 
linear operators on R”. This is done using the operator norm of T defined 


by 


= T 
ITI = max (T(x) 


where |x| denotes the Euclidean norm of x € R”; i.e., 


Ix] = a?+--- +22. 


The operator norm has all of the usual properties of a norm, namely, for 
S,T € L(R") 
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(a) |[T'l| 2 0 and |[7|| = 0 iff T=0 
(b) [ATI] = |e] [Tl] fork ER 
(c) ]S+TI < |[S|] + ITI. 


It follows from the Cauchy-Schwarz inequality that if T € L(R”) is rep- 
resented by the matrix A with respect to the standard basis for R", then 
|All < //né where @ is the maximum length of the rows of A. 

The convergence of a sequence of operators T;, € L(R") is then defined 
in terms of the operator norm as follows: 


Definition 1. A sequence of linear operators JT, € L(R”) is said to con- 
verge to a linear operator T € L(R") as k — on, ie., 


lim T, = T, 


k—0o 


if for all « > 0 there exists an N such that for k > N, |IT — Tx|| <e. 
Lemma. For S,T € L(R") andx€R", 

(1) [T(x)| < HT Ix] 

(2) ITSI < IITHNSI 

(3) \IT* || < TIF for k =0,1,2,.... 


Proof. (1) is obviously true for x = 0. For x # 0 define the unit vector 
y = x/|x|. Then from the definition of the operator norm, 


1 
IT] 2 IT(y)| = pe PO: 
(2) For |x| < 1, it follows from (1) that 


IT(S(x))1 < ITI IS(x)| 
S TH MSH |x| 
S ITI MSH. 
Therefore, 
| 7S|| = mp |TS(x)] < ITI ISI 


and (3) is an immediate consequence of (2). 
Theorem. Given T € L(R”) and to > 0, the series 


—. Tek 
1 
= k!\ 


is absolutely and uniformly convergent for all |t| < to. 
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Proof. Let ||T|| = a. It then follows from the above lemma that for |t| < to, 


kyk kiytk kyk 
reek TURE. atthe 
| k! ~ &i 
But 
CO kk 
a to Sx, etto 
kl 


It therefore follows from the Weierstrass M-Test that the series 


a. TKtk 


k=0 kt 


is absolutely and uniformly convergent for all |t| < to; cf. [R], p. 148. 
The exponential of the linear operator T is then defined by the absolutely 
convergent series 


It follows from properties of limits that e7 is a linear operator on R” and 
it follows as in the proof of the above theorem that |le” || < ellTl. 

Since our main interest in this chapter is the solution of linear systems 
of the form 


x = Ax, 


we shall assume that the linear transformation T on R” is represented by 
the n x n matrix A with respect to the standard basis for R” and define 
the exponential e“*. 


Definition 2. Let A be an n x n matrix. Then for t € R, 


oo 
At _ Vo Att 
] 
a 


For an n x n matrix A,e“* is an n x n matrix which can be computed 
in terms of the eigenvalues and eigenvectors of A. This will be carried out 
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in the remainder of this chapter. As in the proof of the above theorem 
l|e4*#|| < ell4lll4l where ||A|] = ||T|| and T is the linear transformation 
T(x) = 


We next establish some basic properties of the linear transformation e7 


in order to facilitate the computation of e7 or of the n x n matrix e4. 


Proposition 1. If P and T are linear transformations on R” and S = 
PTP™—', then eS = PeT P-!. 


Proof. It follows from the definition of e> that 


1\k k 
eS = lim ee = P lim op re Pe! Pet: 


n—co oan e 6 


The next result Giisee directly from Propet 1 and Definition 2. 
Corollary 1. If P~! AP = diag[\,] then e4* = Pdiag[e*#*]P-!. 


Proposition 2. If S and T are linear transformations on R” which com- 
mute, i.e., which satisfy ST = TS, then eStT = eSe7. 


Proof. If ST = TS, then by the binomial theorem 
($+T)"=n! So = 
jtk=n 


Therefore, 


n=0j+k=n ~ j=0 


We have used the fact that the product of two absolutely convergent series 
is an absolutely convergent series which is given by its Cauchy product; cf. 
[R], p. 74. 


Upon setting S = —T in Proposition 2, we obtain 


Corollary 2. If T is a linear transformation on R", the inverse of the 
linear transformation e? is given by (e7)—! =e77. 


a-[ 


A _.q|cosb —sinb 
e =e |sinb — cosb}’ 


Corollary 3. If 
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Proof. If 4 = a + ib, it follows by induction that 
F 7 © [Re(A*)  —Im(*) 
b a Im(A*) — Re(A*) 


where Re and Im denote the real and imaginary parts of the complex 
number 4 respectively. Thus, 


4 [Re(#t) -Im (21) 
“Elm ms 
_ pe pore 
~ |Im(e*) — Re(e?) 
_ 5 ba a 


sin b cos b| © 
Note that if a = 0 in Corollary 3, then e4 is simply a rotation through 


b radians. 
Corollary 4. If <5 
A~lo 
then 
7 eNom, 
e* =e 0 | - 


Proof. Write A = al + B where 


0b 
a= 4 
Then al commutes with B and by Proposition 2, 


eA = eeB = ere? , 


And from the definition 
e® =1+B+B7/+---=I1+B 


since by direct computation B? = B* =... =0. 

We can now compute the matrix e4* for any 2x2 matrix A. In Section 1.8 
of this chapter it is shown that there is an invertible 2 x 2 matrix P (whose 
columns consist of generalized eigenvectors of A) such that the matrix 


B=P7-'AP 


has one of the following forms 


A 0 A 1 a —b 
B=(> AF B= |) 1 a B= |; af 
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It then follows from the above corollaries and Definition 2 that 


Mt ae 
Bt _ |e 0 Bt_ rx.) ¢ Bt_ at (cosbt —sinbt 
“= 0 aa = | or ¢  =¢" |sinbt — cosbt 


respectively. And by Proposition 1, the matrix e“¢ is then given by 
et = Pe®t p-!. 


As we shall see in Section 1.4, finding the matrix e“* is equivalent to solving 
the linear system (1) in Section 1.1. 


PROBLEM SET 3 


1. Compute the operator norm of the linear transformation defined by 
the following matrices: 


@) |o -s| 
©) fo 
© |s i} 


Hint: In (c) maximize |Ax|? = 262? + 10z,r2 + x2 subject to the 
constraint z? + 23 = 1 and use the result of Problem 2; or use the 
fact that ||A|| = [Max eigenvalue of A? A]'/?. Follow this same hint 
for (b). 


2. Show that the operator norm of a linear transformation T on R” 
satisfies 


(7 (x)| 
T|| = max |T(x)| = su . 


3. Use the lemma in this section to show that if T is an invertible linear 
transformation then ||T|| > 0 and 


1 
T > —. 
| ITI 


4. If T is a linear transformation on R” with ||T — I|| < 1, prove that T 
is invertible and that the series )-?-_)(J — T)* converges absolutely 
to. T=}. 


Hint: Use the geometric series. 


5. Compute the exponentials of the following matrices: 


(a) 0 a (b) F y (c) : 4 
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@ [sa] of 3] of gd. 


6. (a) For each matrix in Problem 5 find the eigenvalues of e4. 


(b) Show that if x is an eigenvector of A corresponding to the eigen- 
value \, then x is also an eigenvector of e4 corresponding to the 
eigenvalue e*. 


(c) If A = Pdiag[A,;|P—!, use Corollary 1 to show that 


det e4 = etraceé, 


Also, using the results in the last paragraph of this section, show 
that this formula holds for any 2 x 2 matrix A. 


7. Compute the exponentials of the following matrices: 


100 1 0 0 2 0 0 
(a) |0 2 0 (b) |0 2 1 (c) |1 2 OF. 
00 3 00 2 01 2 
Hint: Write the matrices in (b) and (c) as a diagonal matrix S plus 


a matrix N. Show that S and N commute and compute e® as in 
part (a) and e™ by using the definition. 


8. Find 2 x 2 matrices A and B such that e4+8 4 e4e%. 


9. Let T be a linear operator on R” that leaves a subspace E Cc R"” 
invariant; i.e., for all x € E, T(x) € E. Show that e7 also leaves E 
invariant. 


1.4 The Fundamental Theorem for Linear 
Systems 


Let A be an n xn matrix. In this section we establish the fundamental fact 
that for x9 € R” the initial value problem 
x = Ax 
x(0) = Xo (1) 
has a unique solution for all ¢ € R which is given by 
x(t) = e4*xy. (2) 


Notice the similarity in the form of the solution (2) and the solution z(t) = 
e*'xo of the elementary first-order differential equation < = az and initial 
condition +(0) = Zp. 
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In order to prove this theorem, we first compute the derivative of the 
exponential function e“* using the basic fact from analysis that two con- 
vergent limit processes can be interchanged if one of them converges uni- 
formly. This is referred to as Moore’s Theorem; cf. Graves [G], p. 100 or 
Rudin [R], p. 149. 


Lemma. Let A be a square matriz, then 
d 
oe eAt =A eAt 


dt 


Proof. Since A commutes with itself, it follows from Proposition 2 and 
Definition 2 in Section 3 that 


dary eA(tth) _ edt 
a oe ie 
= lim ar (er” -f) 
h-0 
2 kpk-1 
= e4t lim lim Ae? ange 
h-0 k—-100 2! k! 


The last equality follows since by the theorem in Section 1.3 the series defin- 
ing e4" converges uniformly for |h| < 1 and we can therefore interchange 
the two limits. 


Theorem (The Fundamental Theorem for Linear Systems). Let A 
be ann x n matriz. Then for a given Xo € R", the initial value problem 


x = Ax 
1 
x(0) = Xo (1) 
has a unique solution given by 
x(t) = e4*xp. (2) 


Proof. By the preceding lemma, if x(t) = e4*xo, then 
x'(t) = foxy = Ae“'xy = Ax(t) 


for all t € R. Also, x(0) = [xg = Xo. Thus x(t) = e4*xo is a solution. To 
see that this is the only solution, let x(t) be any solution of the initial value 
problem (1) and set 


y(t) = e~“*x(t). 
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Then from the above lemma and the fact that x(t) is a solution of (1) 
y(t) = —Ae~“*x(t) + e~4*x’(t) 

= —Ae~4“'x(t) + e~4*Ax(t) 

= 0 
for all t € R since e~4* and A commute. Thus, y(t) is a constant. Setting 
t = 0 shows that y(t) = xo and therefore any solution of the initial value 
problem (1) is given by x(t) = e4ty(t) = e4tx 9. This completes the proof 
of the theorem. 


Example. Solve the initial value problem 


x = Ax 

x(0) = 0 
a —2 -1 
a= oa 


and sketch the solution curve in the phase plane R?. By the above theorem 
and Corollary 3 of the last section, the solution is given by 


_ At. _ .-2¢ [cost —sint] [1] —_», [cost 
Eee on al 0 ~€ ~“Isint] ’ 


It follows that |x(t)| = e~*! and that the angle 0(t) = tan~!z2(t)/z,(t) = t. 
The solution curve therefore spirals into the origin as shown in Figure 1 
below. 


Xo 


Figure 1 
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PROBLEM SET 4 


1. Use the forms of the matrix e?* computed in Section 1.3 and the 


theorem in this section to solve the linear system x = Bx for 


wa | 
maf | 
(c) B= f a 


2. Solve the following linear system and sketch its phase portrait 
to (=k =) 
x=], _1|* 
The origin is called a stable focus for this system. 


3. Find e“* and solve the linear system x = Ax for 
3 1 
era= f 4 


(b) A=|j i 


Cf. Problem 1 in Problem Set 2. 


10 0 
A=j]1 2. O|. 
10 -1 


Compute the 3 x 3 matrix e“* and solve x = Ax. Cf. Problem 2 in 
Problem Set 2. 


4. Given 


5. Find the solution of the linear system x = Ax where 


wry 
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6. Let T be a linear transformation on R” that leaves a subspace E C 
R” invariant (i.e., for all x € E, T(x) € E) and let T(x) = Ax with 
respect to the standard basis for R”. Show that if x(t) is the solution 
of the initial value problem 


x = Ax 
x(0) = xo 
with xo € FE, then x(t) € E for allt € R. 


7. Suppose that the square matrix A has a negative eigenvalue. Show 
that the linear system x = Ax has at least one nontrivial solution 
x(t) that satisfies 

lim x(t) = 0. 
t-—»00 


8. (Continuity with respect to initial conditions.) Let (t,x) be the so- 
lution of the initial value problem (1). Use the Fundamental Theorem 
to show that for each fixed te R 


ym, H(t, y) = P(t, Xo). 


1.5 Linear Systems in R? 


In this section we discuss the various phase portraits that are possible for 
the linear system 

x = Ax (1) 
when x € R? and A is a 2 x 2 matrix. We begin by describing the phase 
portraits for the linear system 


x = Bx (2) 


where the matrix B = P-!AP has one of the forms given at the end of 
Section 1.3. The phase portrait for the linear system (1) above is then 
obtained from the phase portrait for (2) under the linear transformation of 
coordinates x = Py as in Figures 1 and 2 in Section 1.2. 

First of all, if 


A 0 A 1 a- 
sefb See = of 
it follows from the fundamental theorem in Section 1.4 and the form of the 


matrix e?* computed in Section 1.3 that the solution of the initial value 
problem (2) with x(0) = xo is given by 


ert 


x= [9 Lolo, x-e"[) jx. 
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or 


_ gt jcosbt = —sin dt 
2 = bt cos bt 
respectively. We now list the various phase portraits that result from these 
solutions, grouped according to their topological type with a finer classifi- 
cation of sources and sinks into various types of unstable and stable nodes 
and foci: 


Case I. B= |} 7 with A <0 < p. 


Xo 


Figure 1. A saddle at the origin. 


The phase portrait for the linear system (2) in this case is given in 
Figure 1. See the first example in Section 1.1. The system (2) is said to 
have a saddle at the origin in this case. If p < 0 < A, the arrows in 
Figure 1 are reversed. Whenever A has two real eigenvalues of opposite 
sign, A < 0 < yp, the phase portrait for the linear system (1) is linearly 
equivalent to the phase portrait shown in Figure 1; i.e., it is obtained from 
Figure 1 by a linear transformation of coordinates; and the stable and 
unstable subspaces of (1) are determined by the eigenvectors of A as in the 
Example in Section 1.2. The four non-zero trajectories or solution curves 
that approach the equilibrium point at the origin as t — too are called 
separatrices of the system. 


Case II. B= |) 4 with A<p<0orB= A 1 Seah 


lo 

The phase portraits for the linear system (2) in these cases are given in 
Figure 2. Cf. the phase portraits in Problems 1(a), (b) and (c) of Problem 
Set 1 respectively. The origin is referred to as a stable node in each of these 
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cases. It is called a proper node in the first case with A = yu and an improper 
node in the other two cases. If A > y > 0 or if A > 0 in Case II, the arrows 
in Figure 2 are reversed and the origin is referred to as an unstable node. 
Whenever A has two negative eigenvalues ’ < p < 0, the phase portrait 
of the linear system (1) is linearly equivalent to one of the phase portraits 
shown in Figure 2. The stability of the node is determined by the sign of 
the eigenvalues: stable if X < 4 < 0 and unstable if A > 4 > 0. Note that 
each trajectory in Figure 2 approaches the equilibrium point at the origin 
along a well-defined tangent line 6 = 09, determined by an eigenvector of 
A, as t — oo. 


Xe X2 X2 

xX) xy XY 
6 re) 0 
N= pe N<p A<O 


Figure 2. A stable node at the origin. 


a 


Case III. B = h 


pe with a < 0. 
a 


b<O 


Figure 3. A stable focus at the origin. 


The phase portrait for the linear system (2) in this case is given in 
Figure 3. Cf. Problem 9. The origin is referred to as a stable focus in these 
cases. If a > 0, the trajectories spiral away from the origin with increasing 
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t and the origin is called an unstable focus. Whenever A has a pair of 
complex conjugate eigenvalues with nonzero real part, a + 1b, with a < 0, 
the phase portraits for the system (1) is linearly equivalent to one of the 
phase portraits shown in Figure 3. Note that the trajectories in Figure 3 do 
not approach the origin along well-defined tangent lines; i.e., the angle 0(t) 
that the vector x(t) makes with the z)-axis does not approach a constant 
Op as t — oo, but rather |@(t)| > 00 as t > 00 and |x(t)| — 0 as t — ©0 in 
this case. 
0 -b 

Case IV. B= : 0 

The phase portrait for the linear system (2) in this case is given in 
Figure 4. Cf. Problem 1(d) in Problem Set 1. The system (2) is said to 
have a center at the origin in this case. Whenever A has a pair of pure 
imaginary complex conjugate eigenvalues, +ib, the phase portrait of the 
linear system (1) is linearly equivalent to one of the phase portraits shown 
in Figure 4. Note that the trajectories or solution curves in Figure 4 lie on 
circles |x(t)| = constant. In general, the trajectories of the system (1) will 
lie on ellipses and the solution x(t) of (1) will satisfy m < |x(t)| < M for all 
t € R; cf. the following Example. The angle 6(t) also satisfies |O(t)| — co 
as t — oo in this case. 


b>0 b<O 


Figure 4. A center at the origin. 


If one (or both) of the eigenvalues of A is zero, i.e., if det A = 0, the 
origin is called a degenerate equilibrium point of (1). The various portraits 
for the linear system (1) are determined in Problem 4 in this case. 


Example (A linear system with a center at the origin). The linear 
system 
x = Ax 


aah 


with 
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has a center at the origin since the matrix A has eigenvalues \ = +21. 
According to the theorem in Section 1.6, the invertible matrix 


p=|; 4 with p= [19 + 


reduces A to the matrix 


0 -2 
sp? _ 


The student should verify the calculation. 
The solution to the linear system x = Ax, as determined by Sections 1.3 
and 1.4, is then given by 


cos2t —sin2t] __, cos2t —2sin2t 
os a ir 2t cos > ice ee sin2t cos 2t 
where c = x(0), or equivalently by 


x(t) = c, cos 2t — 2c sin 2t 
Zo(t) = 1/2c) sin 2t + ce cos 2t. 


It is then easily shown that the solutions satisfy 
x? (t) + 4a2(t) = c? + 4c3 


for all t € R; i.e., the trajectories of this system lie on ellipses as shown in 
Figure 5. 


Xo 


Figure 5. A center at the origin. 


Definition 1. The linear system (1) is said to have a saddle, a node, a 
focus or a center at the origin if the matrix A is similar to one of the 
matrices B in Cases I, II, III or IV respectively, i.e., if its phase portrait 
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is linearly equivalent to one of the phase portraits in Figures 1, 2, 3 or 4 
respectively. 


Remark. If the matrix A is similar to the matrix B, i.e., if there is a nonsin- 
gular matrix P such that P~! AP = B, then the system (1) is transformed 
into the system (2) by the linear transformation of coordinates x = Py. If 
B has the form III, then the phase portrait for the system (2) consists of 
either a counterclockwise motion (if 6 > 0) or a clockwise motion (if b < 0) 
on either circles (if a = 0) or spirals (if a # 0). Furthermore, the direction 
of rotation of trajectories in the phase portraits for the systems (1) and 
(2) will be the same if det P > 0 (i.e., if P is orientation preserving) and 
it will be opposite if det P < 0 (i.e., if P is orientation reversing). In either 
case, the two systems (1) and (2) are topologically equivalent in the sense 
of Definition 1 in Section 2.8 of Chapter 2. 

For det A # 0 there is an easy method for determining if the linear system 
has a saddle, node, focus or center at the origin. This is given in the next 
theorem. Note that if det A # 0 then Ax = 0 iff x = 0; i.e., the origin is 
the only equilibrium point of the linear system (1) when det A # 0. If the 
origin is a focus or a center, the sign o of <2 for z2 = O (and for small 
xz, > 0) can be used to determine whether the motion is counterclockwise 
(if o > 0) or clockwise (if 0 < 0). 


Theorem. Let 6 = det A andr = trace A and consider the linear system 
x = Ax. (1) 
(a) If 5 <0 then (1) has a saddle at the origin. 


(b) If 5 >0 and r? — 46 > 0 then (1) has a node at the origin; it is stable 
if tT <0 and unstable if r > 0. 


(c) If6 >0, r?—46 <0, andr #0 then (1) has a focus at the origin; it 
is stable if r <0 and unstable ifr > 0. 


(d) If6 >0 andr =0 then (1) has a center at the origin. 
Note that in case (b), 7? > 4|6| > 0; i-e., 7 £0. 


Proof. The eigenvalues of the matrix A are given by 


_ttvr?- 46 
= 


Thus (a) if 6 < 0 there are two real eigenvalues of opposite sign. 

(b) If 6 > 0 and r? — 46 > 0 then there are two real eigenvalues of the 
same sign as T; 

(c) if 6 > 0, r?— 46 < 0 and r $ 0 then there are two complex conjugate 
eigenvalues \ = a + ib and, as will be shown in Section 1.6, A is similar to 
the matrix B in Case III above with a = 7/2; and 


A 
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(d) if 6 > 0 and 7 = O then there are two pure imaginary complex 
conjugate eigenvalues. Thus, cases a, b, c and d correspond to the Cases I, 
II, III and IV discussed above and we have a saddle, node, focus or center 
respectively. 


Definition 2. A stable node or focus of (1) is called a sink of the linear 
system and an unstable node or focus of (1) is called a source of the linear 
system. 


The above results can be summarized in a “bifurcation diagram,” shown 
in Figure 6, which separates the (7, 6)-plane into three components in which 
the solutions of the linear system (1) have the same “qualitative structure” 
(defined in Section 2.8 of Chapter 2). In describing the topological behavior 
or qualitative structure of the solution set of a linear system, we do not 
distinguish between nodes and foci, but only if they are stable or unstable. 
There are eight different topological types of behavior that are possible for 
a linear system according to whether 6 # 0 and it has a source, a sink, a 
center or a saddle or whether 6 = 0 and it has one of the four types of 
behavior determined in Problem 4. 


Sink Source 


Center 


Degenerate critical point 


0 
Saddle 


Figure 6. A bifurcation diagram for the linear system (1). 


PROBLEM SET 5 


1. Use the theorem in this section to determine if the linear system 
x = Ax has asaddle, node, focus or center at the origin and determine 
the stability of each node or focus: 


@4=|3 a] @4=[) 3] 
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3 1 AX -2 
wa=[ 3) a=[t >] 
0 -1l A 2 
(c) A= ; 4 (f) A= i 1 
2. Solve the linear system x = Ax and sketch the phase portrait for 


@) a=(j "| (@) A= [j 5 
(6) A= [5 | @) a= [5 1 


3. For what values of the parameters a and b does the linear system 
x = Ax have a sink at the origin? 


A=|5 me 


4. If det A = 0, then the origin is a degenerate critical point of x = Ax. 
Determine the solution and the corresponding phase portraits for the 
linear system with 


wa-f 
wae 


0 0 
(c) A= f 4 
Note that the origin is not an isolated equilibrium point in these cases. 
The four different phase portraits determined in (a) with A > 0 or 
A < 0, (b) and (c) above, together with the sources, sinks, centers and 


saddles discussed in this section, illustrate the eight different types of 
qualitative behavior that are possible for a linear system. 


5. Write the second-order differential equation 
~¥+ar+br=0 


as a system in R? and determine the nature of the equilibrium point 
at the origin. 


6. Find the general solution and draw the phase portrait for the linear 
system 


Zi = 727) 
Lo = —2, + 222. 
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What role do the eigenvectors of the matrix A play in determining 
the phase portrait? Cf. Case II. 


. Describe the separatrices for the linear system 


Z} = 2+ 272 
Lo = 32, + 429. 


Hint: Find the eigenspaces for A. 


. Determine the functions r(t) = |x(t)| and 6(t) = tan~!xo(t)/z,(t) for 


the linear system 


Ly = —-22 


T2=> 7) 


. (Polar Coordinates) Given the linear system 


ZL) = az, — bro 


Lo = br, + azo. 


Differentiate the equations r? = x? + 22 and 6 = tan~}(z2/z,) with 
respect to ¢ in order to obtain 


ie 212, + TaZ2 _ &1L2 — Lz 


and 6 
r2 

for r # 0. For the linear system given above, show that these equa- 

tions reduce to 


r=ar and 6=b. 


Solve these equations with the initial conditions r(0) = ro and 6(0) = 
O) and show that the phase portraits in Figures 3 and 4 follow im- 
mediately from your solution. (Polar coordinates are discussed more 
thoroughly in Section 2.10 of Chapter 2). 


1.6 Complex Eigenvalues 


If the 2n x 2n real matrix A has complex eigenvalues, then they occur in 
complex conjugate pairs and if A has 2n distinct complex eigenvalues, the 
following theorem from linear algebra proved in Hirsch and Smale ({H/S] 
allows us to solve the linear system 


x = Ax. 


Theorem. [f the 2n x 2n real matriz A has 2n distinct compler eigenvalues 
Aj; = a; +ib; and 4; = a; — ib; and corresponding complex eigenvectors 
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WwW; =u; + iv; and W, = u; — iv;,j =1,...,n, then {u1,V1,...,Un, Vn} 
is a basis for R2", the matriz 


P=[vi UW; V2 U2 *** Vn Un] 
is invertible and 5 
P- AP = diag i 7 
a real 2n x 2n matrix with 2 x 2 blocks along the diagonal. 
Remark. Note that if instead of the matrix P we use the invertible matrix 
Q=([u. Vi U2 V2 <** Un Val 
then : 
Q-!AQ = diag 3 Ms 


The next corollary then follows from the above theorem and the funda- 
mental theorem in Section 1.4. 


Corollary. Under the hypotheses of the above theorem, the solution of the 


initial value problem 
x = Ax (1) 
x(0) = Xo 
is given by 
cos bjt —sin bt 


i ‘ a;t -1 
x(t) = P diag e™ peoese rel Pr'xo. 


Note that the matrix 
R= cos bt —sin bt 
~ {sin bt cos bt 


represents a rotation through bt radians. 


Example. Solve the initial value problem (1) for 


1-10 O 
1 10 0 
A=!9 09 3 -2al- 
001 1 


The matrix A has the complex eigenvalues 4; = 1+7 and Az = 2+1 (as well 
as A, = 1-7 and Ay = 2-7). A corresponding pair of complex eigenvectors 


is 
0 


0 
1+2 
1 


WwW) =U) tiv; = and w2 = U2 +iv2 = 


Oo OO = a. 
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The matrix 
10 0 0 
010 0 
P=[{vi; ww v2 u)]= 0011 
000 1 
is invertible, 
1 0 0 0 
0 1 0 0 
= 
pois 001 -i1i]’ 
0 0 0 1 
and 
1 -—-1 0O 0 
1 1 0 0 
a | a 
Pr'aP = 0 02 —i1 
0 0 1 2 
The solution to the initial value problem (1) is given by 
e‘cost —e'sint 0 0 
e'sint e'cost 0 0 
x(t) =P = 
(¢) 0 0 e**cost —e*sint 7 
0 0 e**sint e7' cost 
e’cost —e'sint 0 0 
_ e‘sint e‘cost 0 0 
~ | 0 0 e”* (cost + sin t) —2e”* sin t 
0 0 e”' sint e”*(cos t — sin t) 


In case A has both real and complex eigenvalues and they are distinct, 
we have the following result: If A has distinct real eigenvalues 4; and cor- 
responding eigenvectors v;,j = 1,...,k and distinct complex eigenvalues 
Aj = aj+ib; and \; = a;—ib; and corresponding eigenvectors w; = u, tiv; 
and W; = u; —iv;,j =k+1,...,n, then the matrix 


P=[V1 +++ Ve Vk+i Uk+1 *'* Vn Un] 
is invertible and 
P-'AP = diag{A;,..., Ak, Beoi,---, Br] 
where the 2 x 2 blocks 


for j =k+1,...,n. We illustrate this result with an example. 


-3 0 O 
A=] 0 3 -2 
01 1 


Example. The matrix 
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has eigenvalues A, = —3, A2 = 2+ (and Ag = 2 —7). The corresponding 


eigenvectors 
1 0 
v,= 1/0} and wo=ue+ive= /1+i]. 


0 1 


10 0 10 0 
P=j]0 1 1], P-=1|0 1 -1 
00 1 00 1 


-3 0 O 
P-'AP=| 0 2 -1]. 


Thus 


and 


01 2 


The solution of the initial value problem (1) is given by 


et 0 0 
x(t)=P] 0 e%cost —e*sint| P~'xo 
0 esint e*cost 


ee 0 0 
=| 0 e**(cost+sint) —2e”' sin t Xo. 
0 e”' sin t e”* (cost — sin t) 


The stable subspace E* is the 1,-axis and the unstable subspace E™ is the 
2,23 plane. The phase portrait is given in Figure 1. 


Figure 1 
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PROBLEM SET 6 
1. Solve the initial value problem (1) with 


A=|) ah 


2. Solve the initial value problem (1) with 


0-2 O 
A=]1 2 O|. 
0 O -2 


Determine the stable and unstable subspaces and sketch the phase 
portrait. 


3. Solve the initial value problem (1) with 


10 0 
A=1|10 2 -3]. 
13 2 


4. Solve the initial value problem (1) with 


-1 -10 O 
1-10 O 
A=| 9 00 -2 
001 2 


1.7 Multiple Eigenvalues 


The fundamental theorem for linear systems in Section 1.4 tells us that the 


solution of the linear system 
x = Ax (1) 


together with the initial condition x(0) = x9 is given by 
x(t) = e4'xp. 


We have seen how to find the n x n matrix e4¢ when A has distinct eigen- 
values. We now complete the picture by showing how to find e“*, i.e., how 
to solve the linear system (1), when A has multiple eigenvalues. 


Definition 1. Let be an eigenvalue of the n x n matrix A of multiplicity 
m <n. Then for k = 1,...,m, any nonzero solution v of 


(A —AI)kv =0 


is called a generalized eigenvector of A. 
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Definition 2. An n x n matrix N is said to be nilpotent of order k if 
N*¥-! 40 and N*¥ =0. 


The following theorem is proved, for example, in Appendix III of Hirsch 
and Smale (H/S]. 


Theorem 1. Let A be a realn x n matriz with real eigenvalues 1,...,An 
repeated according to their multiplicity. Then there erists a basis of gener- 
alized eigenvectors for R". And if {v,,...,Vn} is any basis of generalized 
eigenvectors for R", the matriz P = [v, --- vp] is invertible, 


A=S+N 
where 
P-'sP = diag[A;], 


the matriz N = A—S is nilpotent of orderk <n, and S and N commute, 
i.e, SN = NS. 


This theorem together with the propositions in Section 1.3 and the fun- 
damental theorem in Section 1.4 then lead to the following result: 


Corollary 1. Under the hypotheses of the above theorem, the linear sys- 
tem (1), together with the initial condition x(0) = xo, has the solution 


Nk- 0 1 
x(t) = Pdiag[e*#*|P-! [1 + Nt+- 1)! ve Xo. 


If \ is an eigenvalue of multiplicity n of an n x n matrix A, then the 
above results are particularly easy to apply since in this case 


S = diag[A] 
with respect to the usual basis for R” and 
N=A-S. 


The solution to the initial value problem (1) together with x(0) = xo is 
therefore given by 


kk 
x(t) = e* [r+ et. + SE] x0 


Let us consider two examples where the n xn matrix A has an eigenvalue 
of multiplicity n. In these examples, we do not need to compute a basis of 
generalized eigenvectors to solve the initial value problem! 
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Example 1. Solve the initial value problem for (1) with 


3 1 
i E i | 
It is easy to determine that A has an eigenvalue \ = 2 of multiplicity 2; 
1.€., M1 = A2 = 2. Thus, 
_ {2 0 
~ 10 2 


1 1 
vea-se[} 3. 


It is easy to compute N2 = 0 and the solution of the initial value problem 
for (1) is therefore given by 


S 


and 


x(t) = e4*x9 = e**[I + Nt]xo 


l+t ¢ 
— pzt 
ake i 1* fx 


Example 2. Solve the initial value problem for (1) with 


0-2 -1 -1 
124141 
A=|o 1 1 Of: 
000 1 


In this case, the matrix A has an eigenvalue A = 1 of multiplicity 4. 
Thus, S= I4, 


-1 -2 -1 -1l 
1 1 1 1 
Ven 0 
0 0 0 0 
and it is easy to compute 
-1 -1 -1 -1l 
0 0 O 90 
2 
pe Lt 2 +b J 


0 0 O QO 


and N? = 0; i.e., N is nilpotent of order 3. The solution of the initial value 
problem for (1) is therefore given by 


x(t) = e'[I + Nt + N*t?/2]xo 
1-t—#¢?/2 -2¢-#7/2 -t-—t?/2 -t-t?/2 
; t 1+t t t 
t? /2 t+t7/2 14 t7/2 t? /2 
0 0 0 1 


| 
® 


Xo. 
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In the general case, we must first determine a basis of generalized eigen- 
vectors for R”, then compute S = P diag[\;|P—! and N = A—S according 
to the formulas in the above theorem, and then find the solution of the ini- 
tial value problem for (1) as in the above corollary. 


Example 3. Solve the initial value problem for (1) when 


1 0 0 
A= |-1 2 0]. 
1 1 2 


It is easy to see that A has the eigenvalues A; = 1, A2 = A3 = 2. And it is 
not difficult to find the corresponding eigenvectors 


1 0 
v,=] 1 and vo= |0/]. 
—2 1 


Nonzero multiples of these eigenvectors are the only eigenvectors of A cor- 
responding to A; = 1 and Ag = A3 = 2 respectively. We therefore must find 
one generalized eigenvector corresponding to A = 2 and independent of v2 
by solving 


—2 0 0 
We see that we can choose v3 = (0, 1,0)?. Thus, 


100 
nant | 1 0 | =a 


-1 1 0 
and N? = 0. The solution is then given by 
e’ 0 0 
x(t)=P|0 e7 O| P7'[I+ Nt|xo 
0 0 e 
et 0 0 
_ ot — ert et 0 | x0. 


—2e'+(2—t)e** te et 
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In the case of multiple complex eigenvalues, we have the following theo- 
rem also proved in Appendix III of Hirsch and Smale [H/S]: 


Theorem 2. Let A be a real 2n x 2n matriz with compler eigenvalues 
A; =a; +ib; and A; =a; —ibj;, 7 =1,...,n. Then there exists generalized 


compler eigenvectors W; = u; + iv; and W; =u; —ivj;,i=1,...,n such 
that {uj,V1,-..,Un, Vn} is a basis for R?". For any such basis, the matrix 
P=[vi ww ::: Vn Un] és invertible, 

A=S+WN 
where 


~10p — diag (99 8 
P~' SP = diag bs | ; 
the matrizt N = A-—S is nilpotent of order k < 2n, and S and N commute. 


The next corollary follows from the fundamental theorem in Section 1.4 
and the results in Section 1.3: 


Corollary 2. Under the hypotheses of the above theorem, the solution of 
the initial value problem (1), together with x(0) = Xo, is given by 


_ pa a;t (c08bj;t —sinbst}) ,-4 - Nétk 
x(t) = Pdiage j har cos byt P I+ + ae Xo. 


We illustrate these results with an example. 


Example 4. Solve the initial value problem for (1) with 


0-10 O 
100 0 
A=1'9 00 -1\° 
2 01 0 


The matrix A has eigenvalues X = i and \ = —i of multiplicity 2. The 

equation 

-—i -l 0 0 21 
1 -2 0 0 22 
0 0 -: -1l 23 
2 0 1 -2 z4 

is equivalent to z} = zo = 0 and zg = iz4. Thus, we have one eigenvector 

w = (0,0,i,1)7. Also, the equation 


—2 2% 0 0 Z) 
—-2i -2 0 0 z2 
—2 0 -2 24] |23 
-4i -2 -2i —2] | 2 


(A -—Al)w= =0 


(A — \I)?w = 
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is equivalent to z} = izq and z3 = iz4—2z,. We therefore choose the general- 
ized eigenvector w2 = (i,1,0,1). Then u, = (0,0,0,1)7, v; = (0,0, 1,0)7, 
u2 = (0,1,0,1)7, v2 = (1,0,0,0)7, and according to the above theorem, 


001 0 0 010 
0001 a 0 -1 0 1 
P=!, 0001’ ? =I1 0 0 Of? 
0101 0 1 0 0 
0 -1 O 0 0 -1 0 0 
1 0 0 0} ,-1 1 0 0 0 
S=P 0 00 -l es 0 10 —1]’ 
0 0 1 0 1 0 1 0 
0 00 0 
0 0 0 0 
N=A-S=]9 _1 0 0 
1 00 0 
and N? = 0. Thus, the solution to the initial value problem 
cost —sint 0 0 
sint cost 0 0 -1 
x(t) = 0 0 cost —sint P UU + Né]xo 
0 0 sint cost 
cost —sint 0 0 
= sin t cos t 0 0 
a —tsint sint—tcost cost —sint| * 
sint + tcost —tsint sint cost 


Remark. If A has both real and complex repeated eigenvalues, a combi- 
nation of the above two theorems can be used as in the result and example 
at the end of Section 1.6. 


PROBLEM SET 7 
1. Solve the initial value problem (1) with the matrix 


@) 4=[) | 


o)4=[) 4 
@A=|9 || 
@ 4=[5 1 
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2. Solve the initial value problem (1) with the matrix 


100 
wae 1 | 


321 
ji. f =9 
(b) A=| 0 -1 4 
0 0 1 
100 
(c) A=]-1 2 0 
10 2 
211 
(d) A=|0 2 2}. 
00 2 
3. Solve the initial value problem (1) with the matrix 
0 000 
1001 
() A=!) 9 01 
0 -1 1 0 
2000 
1200 
(F) A=]9 1 9 0 
0012 
1111 
9222 
()A=]3 3 3 3 
4444 
010 O 
100 0 
(4) A=]9 9 1 -1 
001 1 
1-10 O 
110 0 
()A=|]9 9 1 -1 
0 01 1 
1-11 0 
110 1 
()A=| 5 9 7-11 
0 01 1 
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4. The “Putzer Algorithm” given below is another method for comput- 
ing e“* when we have multiple eigenvalues; cf. [W], p. 49. 


e“t =r, (t)I +1ro(t)P; +-°>+1n(t)Pn-1 


where 
Pp=(A-Ail), Po =(A-AiI)(A-Ad2l),...; 
P, = (A-Aj,L)-+-(A— Ant) 
and r;(t), j = 1,...,n, are the solutions of the first-order linear 


differential equations and initial conditions 


r,=Ain with r,(0) =1, 
ro = Agre+r; with r2(0) =0 


ri, =AnTa tTn-1 With r,(0) =0. 
Use the Putzer Algorithm to compute e“* for the matrix A given in 


(a) Example 1 
(b) Example 3 
(c) Problem 2(c) 
(d) Problem 3(b). 


1.8 Jordan Forms 


The Jordan canonical form of a matrix gives some insight into the form 
of the solution of a linear system of differential equations and it is used 
in proving some theorems later in the book. Finding the Jordan canonical 
form of a matrix A is not necessarily the best method for solving the related 
linear system since finding a basis of generalized eigenvectors which reduces 
A to its Jordan canonical form may be difficult. On the other hand, any 
basis of generalized eigenvectors can be used in the method described in the 
previous section. The Jordan canonical form, described in the next theorem, 
does result in a particularly simple form for the nilpotent part N of the 
matrix A and it is therefore useful in the theory of ordinary differential 
equations. 


Theorem (The Jordan Canonical Form). Let A be a real matriz with 
real eigenvalues A;, j = 1,...,k and complex eigenvalues A; = a; +b; and 
A; =a; —ib;, 7 =k+1,...,n. Then there exists a basis {v},..., Vk, Vk-+1; 
Uk+1) --+) Vn, Un} for R2"-*, where v;,j = 1,...,k and wj, j = 
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kK +1,...,m are generalized eigenvectors of Aju; = Re(w;) and v; = 
Im(w;) for j =k+1,...,n, such that the matric P = [v, «++ ve Vieqi 
Uk+1 °** Vn Un] ts invertible and 
B, 
P~'AP = aa __ (1) 
B, 


where the elementary Jordan blocks B = B;,j = 1,...,r are either of the 
form 


A 1 0 - 0 
0 A 1: 0 

B= bask (2) 
QO «- » 1 
0 mae 0 r 

for X one of the real eigenvalues of A or of the form 

D In 0 --- O 
0 D Ip -:-. 0 

Boles (3) 
QO .::- D Ip 
QO .«-- 0 D 


with 
a —b 1 0 0 0 
ae h |: h=|9 4 i a i 4 
for \=a+1b one of the complex eigenvalues of A. 


This theorem is proved in Coddington and Levinson [C/L] or in Hirsch 
and Smale [H/S]. The Jordan canonical form of a given n x n matrix A 
is unique except for the order of the elementary Jordan blocks in (1) and 
for the fact that the 1’s in the elementary blocks (2) or the J9’s in the 
elementary blocks (3) may appear either above or below the diagonal. We 
shall refer to (1) with the B; given by (2) or (3) as the upper Jordan 
canonical form of A. 

The Jordan canonical form of A yields some explicit information about 
the form of the solution of the initial value problem 


x = Ax 
x(0) = Xo (4) 


which, according to the Fundamental Theorem for Linear Systems in Sec- 
tion 1.4, is given by 


x(t) = Pdiagle?s*]P-'xp. (5) 
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If B; = B is an m x m matrix of the form (2) and 4 is a real eigenvalue of 
A then B = AI + N and 


1 ¢ ¢t?/2! .-. t™ /(m—1)! 
0 1 ¢t «+ t™7?/(m-— 2)! 
eBt — ortpNt_ pt | 0 0 1 ++» t™-3/(m — 3)! 
0 1 
0 0 1 
since the m x m matrix 
0 1 0 0 
0 oO 1 0 
Ne 258 
0 0 1 
0 0 0 
is nilpotent of order m and 
0 0 1 0: 0 00 --- 0 1 
wow (2 9 98 Fore OF mea }9 9 - O OF 
‘ae mee 0 0 Nees 0 


Similarly, if B; = B is a 2m x 2m matrix of the form (3) and A = a + ib is 
a complex eigenvalue of A, then 


R Rt Rt?/2! .-- Rt™-'/(m-1)! 
0 R Rt «+ Rt™-?/(m—2)! 
m—-3 
eBt at {0 0 R ses RE™-* /(m — 3)! 
O -::- R Rt 


where the rotation matrix 


cosbt —sinbt 
sin bt cos bt 
since the 2m x 2m matrix 


0 Ip O 0 
0 0 2 0 
B= LA 
0 0 2 
0 0 O 
is nilpotent of order m and 
0 0 Ip ::: 0 0 0 -- 0 Ib 
N2 = 0 0 0 2 ::- O Nm) = 0 .:-:- 0 


QO --- 0 QO... 0 
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The above form of the solution (5) of the initial value problem (4) then 
leads to the following result: 


Corollary. Each coordinate in the solution x(t) of the initial value problem 
(4) is a linear combination of functions of the form 


t*e*t cosbt or t*e* sin bt 


where \ = a + ib is an eigenvalue of the matrix A andO<k<n-1. 


We next describe a method for finding a basis which reduces A to its 
Jordan canonical form. But first we need the following definitions: 


Definition. Let 4 be an eigenvalue of the n x n matrix A of multiplicity 
n. The deficiency indices 


6, = dim Ker(A — AI)*. 


The kernel of a linear operator T: R" — R” 
Ker(T) = {x € R” | T(x) = O}. 


The deficiency indices 6, can be found by Gaussian reduction; in fact, 5, 
is the number of rows of zeros in the reduced row echelon form of (A—AJ)*. 
Clearly 

65 $62 S++ Sop =H. 

Let 1; be the number of elementary Jordan blocks of size k x k in the 
Jordan canonical form (1) of the matrix A. Then it follows from the above 
theorem and the definition of 6, that 


6) =M+ut:: +m 
62 = Wt 2Qot+---+2yy, 
63 = 44+ 242 + 343 +--- +3 


On—-1 = YY + 209 + 33 +--+ (nN—1)m-1+(n—-1)% 
Vy + Qe + 3vg +--+ +(n—-—1)yp-1 + np. 


mH 
3 
| 


Cf. Hirsch and Smale [H/S], p. 124. These equations can then be solved for 


V} = 26, — b2 
Vo = 262 — 63 — 61 


Ve = 26, — Oxy) — Oe-1 for lL <k <n 


Yn = On = On—1- 
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Example 1. The only upper Jordan canonical forms for a 2 x 2 matrix 
with a real eigenvalue A of multiplicity 2 and the corresponding deficiency 


indices are given by 
A 0 d A 1 
o ay 3 Ilo A 


6, = 62 =2 6, = 1,62 =2. 


Example 2. The (upper) Jordan canonical forms for a 3 x 3 matrix with a 
real eigenvalue 2 of multiplicity 3 and the corresponding deficiency indices 
are given by 


A 0 0 A 1 0 A 1 0 
0 A 0 0 A 0 0 Al 
0 0A 0 0A 004A 


6; = 62 = 63 =3 6; =2,62 =63 =3 6; = 1,62 = 2,63 = 3. 


We next give an algorithm for finding a basis B of generalized eigenvec- 
tors such that the n x n matrix A with a rea] eigenvalue A of multiplicity n 
assumes its Jordan canonical form J with respect to the basis B; cf. Curtis 
[Cu]: 


1. Find a basis {vi ee , for Ker(A—AJ); i.e., find a linearly independent 
set of eigenvectors of A corresponding to the eigenvalue A. 


2. If 62 > 61, choose a basis {V‘")}41_, for Ker(A — AJ) such that 
(A— AI)vi? =v 


has 62 —6, linearly independent solutions vy ) 7 =1,...,62—6,. Then 
{v}9 = {vin }e aU {vy 25 7° is a baie for Ker(A - rI)?. 


3. If 53 > 52, choose a basis {V\7)}%2., for Ker(A — AI)? with V? € 
span{v\”) yale for j = 1,...,62 — 6; such that 


(A-AD)v9) = Vv?) 


has 63 — 62 linearly independent solutions ve ) »j=1,...,63 — dg. If 
for j= 1,...,62— 61, Vj) = Davy let vo - woah o Vv) 
and VS!) = V") for j = 62 — 6; +1,...,61. Then 

{v5 ¥5 21 = (V5 Her UV HU vp en 
is a basis for Ker(A — X/)°. 
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4. Continue this process untill the kth step when 6, = n to obtain 
a basis B = {ve 123 for R”. The matrix A will then assume its 
Jordan canonical form with respect to this basis. 


The diagonalizing matrix P = [v,---v,] in the above theorem which 
satisfies P~! AP = J is then obtained by an appropriate ordering of the 
basis B. The manner in which the matrix P is obtained from the basis 
B is indicated in the following examples. Roughly speaking, each general- 
ized eigenvector vy" satisfying (A — AI vi?) = vo is listed immediately 


following the generalized eigenvector v™ 


Example 3. Find a basis for R* which reduces 


2 1 0 
A=]0 2 0 
0 -1 2 


to its Jordan canonical form. It is easy to find that A = 2 is an eigenvalue 
of multiplicity 3 and that 


0 1 0 
A-AIT=|0 O OO]. 
0 -1 0 


Thus, 6; = 2 and (A — AJ)v = 0 is equivalent to r2 = 0. We therefore 


choose 
1 0 
vi) = |0| and vi) = |0 
0 1 


as a basis for Ker(A — AJ). We next solve 


0 1 O Ci 
0 0 0 v =cyv$)) + egv§!) = 0}. 


0 -1 O C2 


This is equivalent to x2 = c, and —22 = C9; i.e., c; = —Cc2. We choose 


1 0 1 
vi) = | Oo} ,vi? = 11] and vf? = [0]. 
-1 0 0 


These three vectors which we re-label as v;, v2 and v3 respectively are then 
a basis for Ker(A — AJ)? = R%. (Note that we could also choose vo) = 
v3 = (0,0,1)7 and obtain the same result.) The matrix P = [v;, v2, v3] 
and its inverse are then given by 


1 01 00 -1 
P=] 0 1 Oj] andP'=]0 1 O 


-1 0 0 10 1 
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respectively. The student should verify that 


21 0 
P-1AP = |0 O|. 
2 


2 
0 0 


Example 4. Find a basis for R‘ which reduces 


O a) 22) =I 
12 11 
A=|o9 0 1 0 
0 0 1 1 


to its Jordan canonical form. We find A = 1 is an eigenvalue of multiplicity 
4 and 


-1 -1 -2 -1 
i 2 tft. aA 
A-M=! 9 9 0 of: 
0 0 1 0 
Using Gaussian reduction, we find 6; = 2 and that the following two vectors 
—1 —1 


1 1 1 0 
w=] i} yw}? 
0 1 
span Ker(A — AJ). We next solve 
(A-—Al)v= evi) + cov), 


These equations are equivalent to 73 = cp and 2} +29 +273 +24 = C,. We 
can therefore choose c, = 1, cp = 0, x} = 1, rg = 23 = rq = O and find 


v2) = (1,0,0,0)7 


(with vi) = (—1,1,0,0)7); and we can choose c; = 0, c = 1 = gz, 
Z, = —-1, rg = z4 = 0 and find 


vi?) = (-1,0,1,0)7 


(with vi) = (—1,0,0,1)7). Thus the vectors vi), vi?) vi), v2), which 
we re-label as Vv, V2, V3 and v4 respectively, form a basis B for R‘*. The 


matrix P =[vi --:- v4] and its inverse are then given by 
-1 1 -1 -1 0 10 0 
10 0 0 . 2111 
P= 00 0 1]’ fai 0001 
00 1 0 0010 
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and 
1 1 
0 1 
ey | _ 
PAP = 0 0 
0 0 
In this case we have 6; = 2, dg = 63 = 64 = 4, 4. = 26; — db. = 0, 
Vo = 269 — 63 — 6; = 2 and v3 = v4, = 0. 
Example 5. Find a basis for R* which reduces 


0 -2 -1 -1 
1 2 1 ] 
0 1 #1 #0 


to its Jordan canonical form. We find A = 1 is an eigenvalue of multiplicity 


4 and 
—-1 —-2 -1 -1l 


1 2 1 61 
0 1 O- OFf° 
0 0 0 90 


Using Gaussian reduction, we find 6; = 2 and that the following two vectors 
—1 —1 
0 0 
(1) yo 


span Ker(A — AJ). We next solve 
(A — Av = qv) + cav$?). 


The last row implies that cp = 0 and the third row implies that z2 
The remaining equations are then equivalent to rz; + r2 + 73 + %%4 
Thus, viv) = vi) and we choose 


i il 
pat 


vi?) = (—1,1,0,0)’. 


Using Gaussian reduction, we next find that 62 = 3 and CV) yi) vl} 
with vi) = vi) spans Ker(A — J)”. Similarly we find 6; = 4 and we 
must find 63 — d2 = 1 solution of 


2 
(A —-A)v = V0). 


where vi?) = vi?) The third row of this equation implies that rz = 0 and 
the remaining equations are then equivalent to z; +2z3+24 = 0. We choose 


vi?) = (1,0,0,0)7. 
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Then B = {v2 v@) v@) v@} = (VV v2) vO) vo} is a basis for 
Ker(A — AI)? = R‘*. The matrix P = [vi ---v4], with v; = Vi) ve = 
vi) V3 = vi?) and v4 = vi), and its inverse are then given by 


-1 -1 1 -1 0010 
0 10 0 - 010 0 
P=) 1 00 of ™ P=], 4141 
0 00 1 0001 
respectively. And then we obtain 
1100 
0110 
—] = 
PYAP=15 0 1 Ol: 
000 1 


In this case we have 6; = 2, 59 = 3, 63 = 64 = 4, m4 = 26; — dg = 1, 
Vo = 252 — b3 — 4, = 0, V3 = 263 — b4 — 62 = 1 and V4 = 64 — 63 = 0. 
It is worth mentioning that the solution to the initial value problem (4) 


for this last example is given by 


1 
x(t) = e4'xg = Pe’*P-1!xo = Pe! ; 
0 
1—t—t?/2 —2t-1t?/2 
_¢t t 1+t 
t? /2 t+t?/2 
0 0 


PROBLEM SET 8 


t t7/2 0 
1 ¢t O}|,- 
0 1 of? * 
0 0 1 
-t—t?/2 —t—t?/2 
t t 
1+ t?/2 t? /2 aa 
0 1 


1. Find the Jordan canonical forms for the following matrices 


wag 


) 4=[5 | 
(@ A=|1 g 
@ A=|) | 
@4=[) 4] 
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1 1 
(a) A= c 

0 

1 
(b) A= |o 

1 
(c) A= F 

0 


| Pee | 
oo = 
-—- oOo Of CO OefeeK KH OO OF KH OO = 


(d) A= 
1 
(e) A= |0 
0 
1 
0 a= 
0 
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3. (a) List the five upper Jordan canonical forms for a 4 x 4 matrix 
A with a real eigenvalue A of multiplicity 4 and give the corre- 


sponding deficiency indices in each case. 


(b) What is the form of the solution of the initial value problem (4) 


in each of these cases? 


4. (a) What are the four upper Jordan canonical forms for a 4 x 4 


matrix A having complex eigenvalues? 


(b) What is the form of the solution of the initial value problem (4) 


in each of these cases? 


5. (a) List the seven upper Jordan canonical forms for a 5 x 5 ma- 
trix A with a real eigenvalue of multiplicity 5 and give the 
corresponding deficiency indices in each case. 
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(b) What is the form of the solution of the initial value problem (4) 
in each of these cases? 


6. Find the Jordan canonical forms for the following matrices 


1 0 0 
(a) A= 1 2 0 
Hae 


10 0 
(b) A=]-1 2 0 
1 0 


112 
021 
002 
212 
(a4) A=|0 21 
002 
1000 
1200 
(e) A=, 5 3 0 
1234 
1000 
1200 
(f) A=], 9 2 0 
1102 
2140 
0210 
(8) A=|5 9 2 0 
0002 
214 «0 
021 -1 
(hh A=|g 9 2 1 
000 2 


Find the solution of the initial value problem (4) for each of these 
matrices. 


7. Suppose that B is an m x m matrix given by equation (2) and that 
Q = diag[1,¢,e?,...,e"—1]. Note that B can be written in the form 


B=AI+N 
where JN is nilpotent of order m and show that for e > 0 


Q1BQ =I +eN. 
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This shows that the ones above the diagonal in the upper Jordan 
canonical form of a matrix can be replaced by any ¢ > 0. A similar 
result holds when B is given by equation (3). 


8. What are the eigenvalues of a nilpotent matrix N? 


9. Show that if all of the eigenvalues of the matrix A have negative real 
parts, then for all x9 € R” 


jim x(t) =0 
where x(t) is the solution of the initial value problem (4). 


10. Suppose that the elementary blocks B in the Jordan form of the ma- 
trix A, given by (2) or (3), have no ones or [2 blocks off the diagonal. 
(The matrix A is called semisimple in this case.) Show that if all 
of the eigenvalues of A have nonpositive real parts, then for each 
Xo € R” there is a positive constant M such that |x(t)| < M for all 
t > 0 where x(t) is the solution of the initial value problem (4). 


11. Show by example that if A is not semisimple, then even if all of the 
eigenvalues of A have nonpositive real parts, there is an x9 € R” such 
that 


jim [x(t)| = 00. 
Hint: Cf. Example 4 in Section 1.7. 


12. For any solution x(t) of the initial value problem (4) with det A #0 
and Xo # 0 show that exactly one of the following alternatives holds. 


(a) Jim x(t) = 0 and , lim, [x(¢)] = 0°; 

(b) im [x(¢)| = 00 and , lim_ x(t) = 0; 

(c) There are positive constants m and M such that for allt € R 
m < |x(t)| <M; 

(2) liga, bx(t)| = 00 

(e) im |x(t)| = 00, jim. x(t) does not exist; 


(f) lim | |x(t)| = 00, im. x(t) does not exist. 


Hint: See Problem 5 in Problem Set 9. 
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1.9 Stability Theory 


In this section we define the stable, unstable and center subspace, E*, E™ 
and E* respectively, of a linear system 


x = Ax. (1) 


Recall that E* and E“ were defined in Section 1.2 in the case when A had 
distinct eigenvalues. We also establish some important properties of these 
subspaces in this section. 

Let w; = u,; + iv;; be a generalized eigenvector of the (real) matrix A 
corresponding to an eigenvalue 4; = a; + ib;. Note that if b; = 0 then 
v; = 0. And let 


B= {uj,. ~ +) Ug, Ue, Vie+;--- ,Um; Vm} 


be a basis of R® (with n = 2m — k) as established by Theorems 1 and 2 
and the Remark in Section 1.7. 


Definition 1. Let 4; = a; + ib;,w; = uj; + iv; and B be as described 
above. Then 

E* = Span{u,;,v; | a; < 0} 

Ee = Span{u,;, Vv; | aj= 0} 
and 

E* = Span{u,,v; | a; > 0}; 


i.e., £°, E° and E* are the subspaces of R™ spanned by the real and imag- 
inary parts of the generalized eigenvectors w; corresponding to eigenvalues 
A; with negative, zero and positive real parts respectively. 


Example 1. The matrix 


has eigenvectors 
0 
Ww) =u, +iv; = {1 
0 


0 
U2 = ql corresponding to Az = 3. 
1 


1 
+2 q corresponding to A; = —2+72 
0 


and 
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The stable subspace E* of (1) is the x), 22 plane and the unstable subspace 
E” of (1) is the 23-axis. The phase portrait for the system (1) is shown in 
Figure 1 for this example. 


SENS 


Figure 1. The stable and unstable subspaces E* and E™ of the linear 
system (1). 


Example 2. The matrix 


has A; = i,u, = (0,1,0)7,v; = (1,0,0)7, Ao = 2 and uz = (0,0,1)7. The 
center subspace of (1) is the 2), 22 plane and the unstable subspace of (1) 
is the r3-axis. The phase portrait for the system (1) is shown in Figure 2 
for this example. Note that all solutions lie on the cylinders x? + 23 = c?. 


In these examples we see that all solutions in E* approach the equilibrium 
point x = 0 ast — oo and that all solutions in E* approach the equilibrium 
point x = 0 as t — —oo. Also, in the above example the solutions in E* 
are bounded and if x(0) 4 0, then they are bounded away from x = 0 for 
all t € R. We shall see that these statements about E* and E™ are true in 
general; however, solutions in E* need not be bounded as the next example 
shows. 
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ae 
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Figure 2. The center and unstable subspaces E*° and E™ of the linear 


system (1). 


Example 3. Consider the linear system (1) with 


0 0 Zz, =0 
A=[; HE i.e., ene 


Xo 


xy 


Figure 3. The center subspace E* for (1). 
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We have A; = Az = 0,u, = (0,1)? is an eigenvector and ug = (1,0)7 
is a generalized eigenvector corresponding to A = 0. Thus E* = R?. The 
solution of (1) with x(0) = c = (c;,c2)” is easily found to be 


x(t) =c 
x(t) = c(t + co. 


The phase portrait for (1) in this case is given in Figure 3. Some solutions 
(those with c, = 0) remain bounded while others do not. 


We next describe the notion of the flow of a system of differential equa- 
tions and show that the stable, unstable and center subspaces of (1) are 
invariant under the flow of (1). 

By the fundamental theorem in Section 1.4, the solution to the initial 
value problem associated with (1) is given by 


x(t) = e4*xp. 


The set of mappings e4t: R™ — R” may be regarded as describing the 
motion of points Xo € R” along trajectories of (1). This set of mappings 
is called the flow of the linear system (1). We next define the important 
concept of a hyperbolic flow: 


Definition 2. If all eigenvalues of the n x n matrix A have nonzero real 
part, then the flow e4*: R® — R” is called a hyperbolic flow and (1) is 
called a hyperbolic linear system. 


Definition 3. A subspace E C R” is said to be invariant with respect to 
the flow e4t; R® +R" if e4*E C E for allt ER. 

We next show that the stable, unstable and center subspaces, E°, E* and 
E* of (1) are invariant under the flow e“* of the linear system (1); i.e., any 
solution starting in E*, BE“ or E* at time t = 0 remains in E*, E” or E* 
respectively for all t € R. 


Lemma. Let E be the generalized eigenspace of A corresponding to an 
eigenvalue A. Then AE C E. 


Proof. Let {v:,..., vx} be a basis of generalized eigenvectors for E. Then 
given v € E, 


k 
v= > CjVj 
j=l 
and by linearity 


k 
Av = >> Avy. 


j=l 
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Now since each v; satisfies 
(A —Al)*v; =0 
for some minimal k;, we have 
(A —Al)v; = V; 
where V; € Ker(A — AI)*s-! C E. Thus, it follows by induction that 
Av; = Av; + V; € E and since E is a subspace of R”, it follows that 


k 
> Av; é€ E; 


j=1 
i.e, Av € E and therefore AE CE. 
Theorem 1. Let A be a realn x n matriz. Then 
R"® = E° @E“ @ ES 


where E*, E“ and E* are the stable, unstable and center subspaces of (1) 
respectively; furthermore, E*, E“ and E* are invariant with respect to the 
flow e“* of (1) respectively. 


Proof. Since B = {uj,..., Uk, Uk41, Ve+1)-+-;Um;Vm} described at the 
beginning of this section is a basis for R”, it follows from the definition of 
E*, E™ and E* that 
R®°=E*° @E"@ E*. 

If xo € E* then 

Ne 

Xo = > cj V; 
j=l 


where V; = v; or u; and {V;}'*, C B is a basis for the stable subspace 


E®* as described in Definition 1. Then by the linearity of e“*, it follows that 


But 
Akt 
e*tvV, = lim [r+ Att. V;€ E* 
k-»00 k! 
since for j = 1,...,n, by the above lemma A‘V; € E* and since E”® is 


complete. Thus, for all t € R,e4*xg € E* and therefore e4*E* C E’; i.e., 
E® is invariant under the flow e“*. It can similarly be shown that E*% and 
E* are invariant under the flow e“*. 
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We next generalize the definition of sinks and sources of two-dimensional 
systems given in Section 1.5. 


Definition 4. If all of the eigenvalues of A have negative (positive) real 
parts, the origin is called a sink (source) for the linear system (1). 


Example 4. Consider the linear system (1) with 


—-2 -1 0 
A=|1 -2 0O 
0 O -3 
We have eigenvalues 4; = —2 +i and Az = —3 and the same eigenvectors 


as in Example 1. E° = R® and the origin is a sink for this example. The 
phase portrait is shown in Figure 4. 


X3 


Xo 


Figure 4. A linear system with a sink at the origin. 


Theorem 2. The following statements are equivalent: 


(a) For allxgo € R", jim e4tx, = 0 and for xo #0, Jim. \e4*x9| = 00. 


(b) All eigenvalues of A have negative real part. 
(c) There are positive constants a,c,m and M such that for all xo € R” 
je“*xo| < Me“ |xo| 


fort >0 and 
le4*xo| > me~%'|xo| 
fort <0. 


Proof (a => b): If one of the eigenvalues \ = a + 7b has positive real part, 
a > 0, then by the theorem and corollary in Section 1.8, there exists an 
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Xo € R",xo ¥ 0, such that |e4*xg| > e*'|xo|. Therefore |e“'x9| — 00 as 
t — oc: 1.e., 

lim eAtx, # 0. 

t—0o 
And if one of the eigenvalues of A has zero real part, say = ib, then by the 
corollary in Section 1.8, there exists x») € R",x 9 4 O such that at least one 


component of the solution is of the form ct* cos bt or ct* sin bt with k > 0. 
And once again 


lim e4'x9 4 0. 

t—0o 
Thus, if not all of the eigenvalues of A have negative real part, there exists 
Xo € R” such that e4'x9 4 O as t > ov; i.e., a > b. 

(b => c): If all of the eigenvalues of A have negative real part, then 
it follows from the Jordan canonical form theorem and its corollary in 
Section 1.8 that there exist positive constants a, c, m and M such that 
for all x9 € R"le4txg| < Me~'|xo| for t > 0 and |e4'xo| > me~**|xo| for 
t< 0. 

(c => a): If this last pair of inequalities is satisfied for all xo € R”, it 


follows by taking the limit as t — too on each side of the above inequalities 
that 


lim |e“'x9|=0 andthat lim |e4!xo| = 00 
t—-00 t—+—oc 
for Xo # 0. This completes the proof of Theorem 2. 


The next theorem is proved in exactly the same manner as Theorem 2 
above using the theorem and its corollary in Section 1.8. 


Theorem 3. The following statements are equivalent: 


(a) For allxo € R”. limp. e4“'xo = 0 and for Xo ¥ 0, limy_.o |e4*xo| = 
OO. 


(b) All eigenvalues of A have positive real part. 


(c) There are positive constants a,c,m and M such that for all xo € R” 
le“*xo| < Me“ |xo| 


fort <0 and 
le“*xo| > me**|xo| 


fort > 0. 
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Corollary. If xo € E°, then e4“txg € E® for allt € R and 
lim e4*x9 = 0. 
t—-0o 

And if x9 € E“, then e4*xg € E* for allt € R and 


lim e4tx 9 = 0. 
t—-—0o 


Thus, we see that all solutions of (1) which start in the stable manifold 
E* of (1) remain in E* for all ¢ and approach the origin exponentially fast 
as t — oo; and all solutions of (1) which start in the unstable manifold 
E™ of (1) remain in E™ for all ¢ and approach the origin exponentially fast 
as t — —oo. As we shall see in Chapter 2 there is an analogous result for 
nonlinear systems called the Stable Manifold Theorem; cf. Section 2.7 in 
Chapter 2. 


PROBLEM SET 9 


1. Find the stable, unstable and center subspaces E*, E¥ and E* of the 
linear system (1) with the matrix 


; -1 -1 
(i) A= 1 ah 
Also, sketch the phase portrait in each of these cases. Which of these 
matrices define a hyperbolic flow, e4*? 
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2. Same as Problem 1 for the matrices 


-1 00 
w4-| 0 -2 | 


0 O 3 
0-1 O 
(b) A=]1 0O 0 
0 oO -1l 
-1 -3 0 
(c) A= | 0 2 O 
0 O -1 
2 3 #O 
(d) A=|O0 -1 OF}. 
0 O -1l 
3. Solve the system 
0 2 0 
x=]/-2 0 O|x. 
2 0 6 


Find the stable, unstable and center subspaces E°, E“ and E* for 
this system and sketch the phase portrait. For xo € E°, show that 
the sequence of points x, = e4"x9 € E*; similarly, for x9 € E® or 
E™, show that x, € E*° or E™ respectively. 


. Find the stable, unstable and center subspaces E°, E“ and E* for the 
linear system (1) with the matrix A given by 


(a) Problem 2(b) in Problem Set 7. 
(b) Problem 2(d) in Problem Set 7. 


. Let A be an n x n nonsingular matrix and let x(t) be the solution of 
the initial value problem (1) with x(0) = xo. Show that 


(a) if xo € B® ~ {0} then jim x(t) = O and lim |x(t)| = 00; 
(b) if x9 € EY ~ {0} then jim |x(t)| = co and lim | x(t) = 0; 


(c) if x» € E* ~ {0} and A is semisimple (cf. Problem 10 in Sec- 
tion 1.8), then there are positive constants m and M such that 
for all t €e R,m < |x(t)| < M; 
(d,) if x» € E° ~ {0} and A is not semisimple, then there is an 
Xo € R" such that jim |x(t)| = 00; 


(do) if E® 4 {0}, EX # {0}, and xo € E* @ E" ~ (E* U E%), then 
Jim, Ix(@)| = 003 
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(e) if EY # {0}, E* # {0} and xo € E“ @ ES ~ (E“ U E*), then 
jim |x(t)| = 00; lim | x(t) does not exist; 


(f) if E* 4 {0}, E° # {0}, and x9 € E* @ ES ~ (E* UE‘), then 
jim. |x(t)| = 00, jim x(t) does not exist. Cf. Problem 12 in 
Problem Set 8. 


6. Show that the only invariant lines for the linear system (1) with x € 
R? are the lines az; + brz2 = 0 where v = (—b,a)" is an eigenvector 
of A. 


1.10 Nonhomogeneous Linear Systems 


In this section we solve the nonhomogeneous linear system 
x = Ax + b(t) (1) 
where A is an n x n matrix and b(t) is a continuous vector valued function. 
Definition. A fundamental matriz solution of 
x = Ax (2) 
is any nonsingular n x n matrix function ®(t) that satisfies 


6'(t) = A®(t) forall teER. 


Note that according to the lemma in Section 1.4, ®(t) = e4* is a fun- 


damental matrix solution which satisfies ®(0) = J, the n x n identity ma- 
trix. Furthermore, any fundamental matrix solution ®(¢) of (2) is given by 
(t) = e4*C for some nonsingular matrix C. Once we have found a fun- 
damental matrix solution of (2), it is easy to solve the nonhomogeneous 
system (1). The result is given in the following theorem. 


Theorem 1. If 6(t) is any fundamental matrix solution of (2), then the 
solution of the nonhomogeneous linear system (1) and the initial condition 
x(0) = Xo is unique and is given by 


x(t) = B(t)®-(0)xo + ij &(t)@-(7)b(r)dr. (3) 


Proof. For the function x(t) defined above, 
x! (t) = &'(t)6—1(0)xo + 6(t) 6-1 (t) b(t) 


—!(+)b(r)dr. 
+ [ ews (r)b(r)d 
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And since ®(t) is a fundamental matrix solution of (2), it follows that 


t 
x(t) =A [8 *(0)xo +/ (0)8-"(rb(r)dr] + b(t) 
0 
= Ax(t) + b(t) 
for all t € R. And this completes the proof of the theorem. 


Remark 1. If the matrix A in (1) is time dependent, A = A(t), then 
exactly the same proof shows that the solution of the nonhomogenous linear 
system (1) and the initial condition x(0) = xo is given by (3) provided that 
@(t) is a fundamental matrix solution of (2) with a variable coefficient 
matrix A = A(t). For the most part, we do not consider solutions of (2) 
with A = A(t) in this book. The reader should consult [C/L], [H] or [W] 
for a discussion of this topic which requires series methods and the theory 
of special functions. 


Remark 2. With ®(t) = e4‘, the solution of the nonhomogeneous linear 
system (1), as given in the above theorem, has the form 


t 
x(t) = e4'xy + e4* [ e~47b(r)dr. 
0 


Example. Solve the forced harmonic oscillator problem 
+2 = f(t). 
This can be written as the nonhomogeneous system 


ry = —Z2 
fa = 2, + f(t) 


or equivalently in the form (1) with 


A=[) Z and b(t) = Pre 


In this case 
At __ cost —sint 
~ Isint cos t 


|=R0, 


a rotation matrix; and 


At cost sint 
e = : 
—sint cost 


| = R(-0. 
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The solution of the above system with initial condition x(0) = xo is thus 
given by 


t 
x(t) = e4'x9 + eA? [ e~ATb(r)dr 
0 


f(r) sin ] - 


f(r) cosr 


= R(t)xo + R(t) / 


It follows that the solution z(t) = 2x,(t) of the original forced harmonic 
oscillator problem is given by 


z(t) = 2(0) cost — £(0) sint + [ f(r) sin(7 — t)dr. 
) 


PROBLEM SET 10 


1. Just as the method of variation of parameters can be used to solve 
a nonhomogeneous linear differential equation, it can also be used to 
solve the nonhomogeneous linear system (1). To see how this method 
can be used to obtain the solution in the form (3), assume that the 
solution x(t) of (1) can be written in the form 


x(t) = &(t)e(t) 


where ®(¢) is a fundamental matrix solution of (2). Differentiate this 
equation for x(t) and substitute it into (1) to obtain 


c'(t) = &-!(t)b(t). 


Integrate this equation and use the fact that c(0) = ®—'(0)xo to 
obtain 


c(t) = 5-1(0)xo + [ &-1(r)b(r)dr. 


Finally, substitute the function c(t) into x(t) = ®(t)c(t) to obtain 


(3). 


2. Use Theorem 1 to solve the nonhomogeneous linear system 


af Je() 


with the initial condition 
1 
x(0) = (6) 
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3. Show that a, 
6(t) = ° cos t a 


e~* sint cos t 
is a fundamental matrix solution of the nonautonomous linear system 
x = A(t)x 
with 
A(t) = Pans -1 oo | 

1—sin2t¢ —2sin*t 
Find the inverse of ®(t) and use Theorem 1 and Remark 1 to solve 
the nonhomogenous linear system 


x = A(t)x + b(t) 


with A(t) given above and b(t) = (1,e72*)7. Note that, in general, 
if A(t) is a periodic matrix of period T, then corresponding to any 
fundamental matrix ©(t), there exists a periodic matrix P(t) of period 
2T and a constant matrix B such that 


&(t) = P(t)e®. 


Cf. [C/L], p. 81. Show that P(t) is a rotation matrix and B = 
diag([—2, 0] in this problem. 


2 


Nonlinear Systems: Local 
Theory 


In Chapter 1 we saw that any linear system 
x = Ax (1) 


has a unique solution through each point x9 in the phase space R"; the 
solution is given by x(t) = e4'x9 and it is defined for all t € R. In this 
chapter we begin our study of nonlinear systems of differential equations 


x = f(x) (2) 


where f: E — R” and E is an open subset of R". We show that under 
certain conditions on the function f, the nonlinear system (2) has a unique 
solution through each point x9 € E defined on a maximal interval of exis- 
tence (a, @) C R. In general, it is not possible to solve the nonlinear system 
(2); however, a great deal of qualitative information about the local behav- 
ior of the solution is determined in this chapter. In particular, we establish 
the Hartman-Grobman Theorem and the Stable Manifold Theorem which 
show that topologically the local behavior of the nonlinear system (2) near 
an equilibrium point xo where f(x) = 0 is typically determined by the be- 
havior of the linear system (1) near the origin when the matrix A = Df(xo), 
the derivative of f at x9. We also discuss some of the ramifications of these 
theorems for two-dimensional systems when det Df(xo) # 0 and cite some 
of the local results of Andronov et al. [A-I] for planar systems (2) with 
det Df(xo) = 0. 


2.1 Some Preliminary Concepts and Definitions 


Before beginning our discussion of the fundamental theory of nonlinear 
systems of differential equations, we present some preliminary concepts 
and definitions. First of all, in this book we shall only consider autonomous 
systems of ordinary differential equations 


x = f(x) (1) 
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as opposed to nonautonomous systems 
x = f(x, t) (2) 


where the function f can depend on the independent variable t; however, any 
nonautonomous system (2) with x € R” can be written as an autonomous 
system (1) with x € R"*+! simply by letting 2,4) = t and 2,4; = 1. The 
fundamental theory for (1) and (2) does not differ significantly although 
it is possible to obtain the existence and uniqueness of solutions of (2) 
under slightly weaker hypotheses on f as a function of t; cf. for example 
Coddington and Levinson [C/L]. Also, see problem 3 in Problem Set 2. 

Notice that the existence of the solution of the elementary differential 
equation 


t= f(t) 
is given by 


x(t) = 2(0) + / f(s) ds 


if f(t) is integrable. And in general, the differential equations (1) or (2) 
will have a solution if the function f is continuous; cf. (C/L], p. 6. However, 
continuity of the function f in (1) is not sufficient to guarantee uniqueness 
of the solution as the next example shows. 


Example 1. The initial value problem 


& = 32/8 


z(0) =0 
has two different solutions through the point (0,0), namely 
u(t) = ¢? 


and 
v(t) =0 


for all t € R. Clearly, each of these functions satisfies the differential equa- 
tion for all t € R as well as the initial condition x(0) = 0. (The first solution 
u(t) = ¢° can be obtained by the method of separation of variables.) Notice 
that the function f(r) = 322/% is continuous at z = 0 but that it is not 
differentiable there. 

Another feature of nonlinear systems that differs from linear systems 
is that even when the function f in (1) is defined and continuous for all 
x € R”, the solution x(t) may become unbounded at some finite time t = 9; 
i.e., the solution may only exist on some proper subinterval (a, @) C R. 
This is illustrated by the next example. 
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Example 2. Consider the initial value problem 


f= 2? 
z(0) = 1. 


The solution, which can be found by the method of separation of variables, 
is given by 


1 
This solution is only defined for t € (—0o, 1) and 


jim z(t) =o. 


The interval (—0o,1) is called the maximal interval of existence of the 
solution of this initial value problem. Notice that the function z(t) = (1 — 
t)~! has another branch defined on the interval (1, 00); however, this branch 
is not considered as part of the solution of the initial value problem since 
the initial time t = 0 ¢ (1,00). This is made clear in the definition of a 
solution in Section 2.2. 

Before stating and proving the fundamental existence-uniqueness theo- 
rem for the nonlinear system (1), it is first necessary to define some termi- 
nology and notation concerning the derivative Df of a function f: R® — 
R”. 


Definition 1. The function f: R" — R” is differentiable at xo € R” if 
there is a linear transformation Df(xo) € L(R”) that satisfies 


lim (£(xo +h) — (xo) — Df(xo)h] _ | 
[h|—-0 [h| 


The linear transformation Df(xo) is called the derivative of f at xo. 


The following theorem, established for example on p. 215 in Rudin [R], 
gives us a method for computing the derivative in coordinates. 


Theorem 1. Jff: R" — R” ts differentiable at xo, then the partial deriva- 
tives oe i,j =1,...,n, all exist at xq and for allx eR", 


“~. Of 
Df(x0)x = 2 Bx, 08s: 


Thus, if f is a differentiable function, the derivative Df is given by the 
nxn Jacobian matrix 
Df = E : 


Ox j 
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Example 3. Find the derivative of the function 


zr) —22 
we 8 


—Z2+ 222 


and evaluate it at the point xp = (1,—1)7. We first compute the Jacobian 
matrix of partial derivatives, 


ah ah 
-_ Or, Oz = 1 —22r9 
P= 158 On| "le -ita) 
Or, Oxr2 
and then 
De(1,—1) = |_| af 


In most of the theorems in the remainder of this book, it is assumed that 
the function f(x) is continuously differentiable; i.e., that the derivative 
Df(x) considered as a mapping Df: R"™ — L(R”) is a continuous function 
of x in some open set E C R”. The linear spaces R” and L(R") are 
endowed with the Euclidean norm |-| and the operator norm || - ||, defined 
in Section 1.3 of Chapter 1, respectively. Continuity is then defined as usual: 


Definition 2. Suppose that V, and V2 are two normed linear spaces with 


respective norms ||; ||; and || - ||2; ie., Vi and V2 are linear spaces with 
norms || - ||; and || - |l2 satisfying a-c in Section 1.3 of Chapter 1. Then 
F: Vi —? Vo 


is continuous at Xo € V, if for all e > O there exists a 6 > 0 such that 
x € V, and {|x — xo||, < 6 implies that 


F(x) — F(xo)ll2 < €. 


And F is said to be continuous on the set E C V;, if it is continuous at each 
point x € E. If F is continuous on E C Vj, we write F € C(E). 


Definition 3. Suppose that f: E — R” is differentiable on E. Then f € 
C'(E) if the derivative Df: E — L(R") is continuous on E. 


The next theorem, established on p. 219 in Rudin [R], gives a simple test 
for deciding whether or not a function f: E — R” belongs to C}(E). 


Theorem 2. Suppose that E is an open subset of R” and thatf: E — R”. 
Then f € C'(E) iff the partial derivatives a, i,j =1,...,n, exist and 
are continuous on E. 
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Remark 1. For E an open subset of R”, the higher order derivatives 
D* (x9) of a function f: E — R” are defined in a similar way and it can 
be shown that f € C*(E) if and only if the partial derivatives 


OF fi 
Or,,:*:OZ;, 


with 7,j1,...,je = 1,...,m, exist and are continuous on £. Furthermore, 
D?f(x9): E x E — R® and for (x,y) € E x E we have 


n 2 
D?£(x9)(x, y) = > ale 


Similar formulas hold for D* f(x): (E x --- x E) > R"; cf. [R], p. 235. 

A function f: E’ — R” is said to be analytic in the open set E C R” if 
each component f;(x), j = 1,...,n, is analytic in E, i.e., if for 7 =1,...,n 
and Xo € E, f;(x) has a Taylor series which converges to f;(x) in some 
neighborhood of Xo in E. 


PROBLEM SET 1 


1. (a) Compute the derivative of the following functions 


2 2 
Ly +2175 +2,2z 
zy, +222 : i sie 
f(x) = 2. ol) £(x)= | -21+22—-T2r3+71F27%3 |. 
—LatI@+2} 2 
Lga+7T3-T; 


(b) Find the zeros of the above functions, i.e., the points x» € R” 
where f(xo) = 0, and evaluate Df(x) at these points. 


(c) For the first function f: R? — R? defined in part (a) above, 
compute D?f(x9)(x,y) where xo = (0,1) is a zero of f. 


2. Find the largest open subset E C R? for which 


(a) f(x) = je is continuously differentiable. 
xi 
|x| + mot 
(b) f(x) = is continuously differentiable. 
V7,+1-V2%2+2 
3. Show that the initial value problem 


& = |x|'/2 


x(0) =0 


has four different solutions through the point (0,0). Sketch these so- 
lutions in the (t, 2)-plane. 
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4. Show that the initial value problem 


t=27° 


z(0) =2 


has a solution on an interval (—oo,b) for some b € R. Sketch the 
solution in the (t, z)-plane and note the behavior of z(t) as t > b-. 


5. Show that the initial value problem 


has a solution z(t) on the interval (0,00), that z(t) is defined and 
continuous on (0,00), but that x’(0) does not exist. 


6. Show that the function F: R? — L(R?) defined by 


aoe | ny “ 


—Z2 TZ) 


is continuous for all x € R? according to Definition 2. 


2.2 The Fundamental Existence-Uniqueness 
Theorem 


In this section, we establish the fundamental existence-uniqueness theorem 
for a nonlinear autonomous system of ordinary differential equations 


x = f(x) (1) 


under the hypothesis that f € C!(E) where E is an open subset of R”. 
Picard’s classical method of successive approximations is used to prove this 
theorem. The more modern approach based on the contraction mapping 
principle is relegated to the problems at the end of this section. The method 
of successive approximations not only allows us to establish the existence 
and uniqueness of the solution of the initial value problem associated with 
(1), but it also allows us to establish the continuity and differentiability 
of the solution with respect to initial conditions and parameters. This is 
done in the next section. The method is also used in the proof of the Stable 
Manifold Theorem in Section 2.7 and in the proof of the Hartman-—Grobman 
Theorem in Section 2.8. The method of successive approximations is one 
of the basic tools used in the qualitative theory of ordinary differential 
equations. 
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Definition 1. Suppose that f € C(E) where E is an open subset of R”. 
Then x(t) is a solution of the differential equation (1) on an interval I if 
x(t) is differentiable on J and if for all t € J, x(t) € E and 


x’ (t) = f(x(t)). 
And given Xo € E, x(t) is a solution of the initial value problem 


x = f(x) 
x(to) = Xo 


on an interval I if to € I, x(to) = Xo and x(t) is a solution of the differential 
equation (1) on the interval J. 

In order to apply the method of successive approximations to establish 
the existence of a solution of (1), we need to define the concept of a Lipschitz 
condition and show that C’ functions are locally Lipschitz. 


Definition 2. Let E be an open subset of R”. A function f: E — R” is 
said to satisfy a Lipschitz condition on E if there is a positive constant K 
such that for all x,y € E 


|f(x) — f(y)| < K|x — y]. 


The function f is said to be locally Lipschitz on E if for each point x9 € E 
there is an e-neighborhood of x9, N,.(xo9) C E and a constant Ko > 0 such 
that for all x,y € Ne(xo) 


|f(x) — f(y)| < Ko|x — y|. 
By an e-neighborhood of a point x» € R”, we mean an open ball of positive 
radius €; i.e., 
N.(Xo) = {x € R® | |x — xo| < e}. 


Lemma. Let E be an open subset of R” and let f: E — R”. Then, if 
f € C'(E), f is locally Lipschitz on E. 


Proof. Since E is an open subset of R”, given xo € E, there is an e > 0 
such that N,(xo) C E. Let 

Pr mee EO 
the maximum of the continuous function Df(x) on the compact set |x — 
Xo| < €/2. Let No denote the ¢/2-neighborhood of x9, N./2(xo). Then for 


x,y € No, set u= y —x. It follows that x + su € No for 0 < s < 1 since 
No is a convex set. Define the function F: [0,1] + R® by 


F(s) = f(x + su). 
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Then by the chain rule, 
F'(s) = Df(x + su)u 
and therefore 
f(y) — f(x) = F(1) — F(0) 
= ‘A F'(s) ds = [ Df(x + su)uds. 


It then follows from the lemma in Section 1.3 of Chapter 1 that 
1 
ity) - £00) < [De + su)ulds 
0 


1 
< | ||Df(x + su)|}]ul ds 
0 
< Klu] = Kly — x|. 
And this proves the lemma. 


Picard’s method of successive approximations is based on the fact that 
x(t) is a solution of the initial value problem 


x = f(x) 


x(0) = Xo (2) 


if and only if x(t) is a continuous function that satisfies the integral equation 


x(t) = Xo +/ f(x(s)) ds. 


The successive approximations to the solution of this integral equation are 
defined by the sequence of functions 


uo(t) = Xo 
: (3) 
usea(t) =x0+ | £(un(s)) ds 
0 
for k = 0,1,2,.... In order to illustrate the mechanics involved in the 


method of successive approximations, we use the method to solve an ele- 
mentary linear differential equation 


Example 1. Solve the initial value problem 


@=ar 
z(0) = 20 
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by the method of successive approximations. Let 


ug(t) = Zo 


and compute 


t 
u,(t) = 29 + | ax ds = rp(1 + at) 
0 


t 2 
uo(t) = 29 + / azo(1 + as) ds = x ¢ +at+ 5) 
0 


t 2 
u3(t) = xo +/ azo (1 +as+ oF) ds 
0 


3t° 
= Io (1+at+ are at? i) 


It follows by induction that 


itt 
u,(t) = ro (1+at+-. -+a a) 
and we see that 
lim u,(t) = zoe. 
k—00 


That is, the successive approximations converge to the solution z(t) = zoe** 
of the initial value problem. 

In order to show that the successive approximations (3) converge to a 
solution of the initial value problem (2) on an interval J = [—a,al, it is 
first necessary to review some material concerning the completeness of the 
linear space C(J) of continuous functions on an interval J = [—a,a]. The 
norm on C(J) is defined as 


lull = sup ju(z)|. 
Convergence in this norm is equivalent to uniform convergence. 


Definition 3. Let V be a normed linear space. Then a sequence {u,} C V 
is called a Cauchy sequence if for all e > 0 there is an N such that k,m > N 
implies that 

luz — Um|| < e. 
The space V is called complete if every Cauchy sequence in V converges to 
an element in V. 


The following theorem, proved for example in Rudin [R] on p. 151, estab- 
lishes the completeness of the normed linear space C(J) with I = [—a, a]. 


Theorem. For I = [—a,a],C(J) is a complete normed linear space. 
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We can now prove the fundamental existence-uniqueness theorem for 
nonlinear systems. 


Theorem (The Fundamental Existence-Uniqueness Theorem). Let E be 
an open subset of R" containing xo and assume that f € C'(E). Then 
there exists ana >0 such that the initial value problem 


x = f(x) 
x(0) = xo 


has a unique solution x(t) on the interval [—a, a]. 


Proof. Since f € C'(E), it follows from the lemma that there is an e- 
neighborhood N,(xo) C E and a constant K > 0 such that for all x,y € 
Nz (Xo), 
|f(x) — f(y)| < A|x— y|. 
Let b = €/2. Then the continuous function f(x) is bounded on the compact 
set 
No = {x € R" | |x — Xo| < 5}. 
Let 
M= max |f(x)|. 


Let the successive approximations u;(t) be defined by (3). Then assuming 
that there exists an a > 0 such that u,(t) is defined and continuous on 
[—a, a] and satisfies 


max |ux(t) — xol <6, (4) 


it follows that f(u,(t)) is defined and continuous on [—a,a] and therefore 
that 


Uux41(t) = Xo +f f(u;(s)) ds 


is defined and continuous on [—a, a] and satisfies 


Iuesa(t) — xol < | If(uz(s))|ds << Ma 


for all t € [—a,a]. Thus, choosing 0 < a < b/M, it follows by induction 
that u,(t) is defined and continuous and satisfies (4) for all t € [—a, a] and 
k= 1,2, 3,<i< 

Next, since for all t € [—a,a] and k = 0,1,2,3,..., ux(t) € No, it follows 
from the Lipschitz condition satisfied by f that for all t € [—a, a] 


lua(t) — u4(t)| < i If(u;(s)) — £(uo(s))| ds 
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t 
<K i Iu, (s) — wo(s)| ds 
< as jus (t) — Xo| 
< Kab. 


And then assuming that 


max. juy(t) — wj-1(6)] < (Ka)? (5) 
for some integer j > 2, it follows that for all t € [—a, a] 
t 
jwsar(t) — ¥s(O1 < f IeCas(e)) - #(us-a(s))14s 


t 
<K [| Jus(s) - uj-1(0)|ds 
< Ka max |u(t) ~ uj-1(¢) 
< (Ka)b. 


Thus, it follows by induction that (5) holds for 7 = 2,3,.... Setting a = Ka 
and choosing 0 < a < 1/K, we see that form >k > N and t € [—a,a] 


m—l 
Jum(t) — ux(t)| < D> Juj4i(t) — u,(t)| 


jak 
co 
< > juj41(t) — u;(¢)| 
j=N 
co aN 
< = — QO. 
< ee ee 


This last quantity approaches zero as N — oo. Therefore, for all « > 0 
there exists an N such that m,k > N implies that 


lum — Uxl| = eal |Um(t) — ux(t)| < €; 


i.e., {ux} is a Cauchy sequence of continuous functions in C((—a, a}). It fol- 
lows from the above theorem that u;(¢t) converges to a continuous function 
u(t) uniformly for all t € [—a,a] as k — oo. And then taking the limit of 
both sides of equation (3) defining the successive approximations, we see 
that the continuous function 


u(é) = im u(t (6) 
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satisfies the integral equation 


u(t) = x9 + [ f(u(s)) ds (7) 


for all t € [—a,a]. We have used the fact that the integral and the limit 
can be interchanged since the limit in (6) is uniform for all t € [—a, a]. 
Then since u(t) is continuous, f(u(t)) is continuous and by the fundamental 
theorem of calculus, the right-hand side of the integral equation (7) is 
differentiable and 


u(t) = f(u(¢)) 


for all t € [—a,a]. Furthermore, u(0) = xo and from (4) it follows that 
u(t) € N.(xo) C E for all t € [(—a,a]. Thus u(t) is a solution of the initial 
value problem (2) on [—a, a]. It remains to show that it is the only solution. 

Let u(t) and v(t) be two solutions of the initial value problem (2) on 
(—a, a]. Then the continuous function |u(t) — v(t)| achieves its maximum 
at some point t, € [—a, a]. It follows that 


ery aa) ve) 
= | i * e(u(s)) — £(v(s)) ds 
\t,| 
< [ If(u(s)) — £(v(s))| ds 
0 


le,| 
< K | |u(s) — v(s)| ds 
0 
< Ka ines |u(t) — v(t)| 
< Kallu — v|. 


But Ka < 1 and this last inequality can only be satisfied if ||u — v|| = 0. 
Thus, u(t) = v(t) on [—a,a]. We have shown that the successive ap- 
proximations (3) converge uniformly to a unique solution of the initial 
value problem (2) on the interval [—a, a] where a is any number satisfying 
0<a<min(¥, 7): 


Remark. Exactly the same method of proof shows that the initial value 
problem 


x = f(x) 
x(to) = Xo 


has a unique solution on some interval [to — a, to + a]. 
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PROBLEM SET 2 


1. (a) Find the first three successive approximations u(t), uo(t) and 
u3(t) for the initial value problem 


t= 7" 


z(0) = 1. 


Also, use mathematical induction to show that for all n > 1, 
un(t) =1+t+---+t%+O(t"*!) ast 40. 

(b) Solve the initial value problem in part (a) and show that the 
function z(t) = 1/(1-t) is a solution of that initial value problem 
on the interval (—oo,1) according to Definition 1. Also, show 
that the first (n + 1)-terms in u,,(t) agree with the first (n + 1)- 
terms in the Taylor series for the function z(t) = 1/(1—t) about 
r=0. 


(c) Show that the function z(t) = (3t)?/*, which is defined and 
continuous for all ¢ € R, is a solution of the differential equation 

_ 1 
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for all t 4 0 and that it is a solution of the corresponding initial 
value problem with z(1/3) = 1 on the interval (0, 00) according 
to Definition 1. 


2. Let A be an n x n matrix. Show that the successive approximations 
(3) converge to the solution x(t) = e4*xo of the initial value problem 


x = Ax 

x(0) = Xp. 
3. Use the method of successive approximations to show that if f(x, t) 
is continuous in ¢ for all ¢ in some interval containing t = 0 and 
continuously differentiable in x for all x in some open set E Cc R” 


containing xo, then there exists an a > 0 such that the initial value 
problem 


x = f(x, t) 
x(0) = xo 


has a unique solution x(t) on the interval [—a, a]. Hint: Define uo(t) = 
Xo and 


t 
Uz41(t) =x0+ | f(u,(s),s) ds 


and show that the successive approximations u,(t) converge uni- 
formly to x(t) on [—a, a] as in the proof of the fundamental existence- 
uniqueness theorem. 


78 


2. Nonlinear Systems: Local Theory 


4. Use the method of successive approximations to show that if the 


matrix valued function A(t) is continuous on [—ao,a9] then there 
exists an a > 0 such that the initial value problem 
& = A(t)® 
6(0) =I 
(where I is the n x n identity matrix) has a unique fundamental 
matrix solution ®(¢) on [—a, a]. Hint: Define ®o(t) = J and 


Syyi(t) = 14 / A(s)®x(s) ds, 


and use the fact that the continuous matrix valued function A(t) 
satisfies || A(t)|| < Mo for all t in the compact set [—ao, ao] to show 
that the successive approximations ®;(t) converge uniformly to ®(t) 
on some interval [—a, a] with a < 1/Mpo and a < apo. 


. Let V be a normed linear space. If T: V — V satisfies 


|T(u) — T(v)]] < elfu — v| 
for all u and v € V with 0 < c < 1 then T is called a contraction 
mapping. The following theorem is proved for example in Rudin [R]: 


Theorem (The Contraction Mapping Principle). Let V be a complete 
normed linear space and T: V — V a contraction mapping. Then 
there exists a unique u € V such that T(u) = u. 


Let f € C!(E) and xo € E. For I = [—a,a] and u € C(/), let 


T(u)(t) = x0 + | £(u(s)) as. 


Define a closed subset V of C(J) and apply the Contraction Mapping 
Principle to show that the integral equation (7) has a unique contin- 
uous solution u(t) for all t € [—a,a] provided the constant a > 0 is 
sufficiently small. 


Hint: Since f is locally Lipschitz on E and xo € E, there are positive 
constants € and Ko such that the condition in Definition 2 is satisfied 
on N.(xo) C E. Let V = {u € C(I) | |lu— xol] < e}. Then V is 
complete since it is a closed subset of C(I). Show that (i) for all u, v € 
V, ||T(u) —T(v)|| < aKollu—v]|| and that (ii) the positive constant a 
can be chosen sufficiently small that for t € [(—a,a], Tou(t) € Ne(xo), 
ie, T: VV. 


. Prove that x(t) is a solution of the initial value problem (2) for all 


t € I if and only if x(t) is a continuous function that satisfies the 
integral equation 


x(t) = Xo + [ f(x(s)) ds 
for all t € I. 
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7. Under the hypothesis of the Fundamental Existence- Uniqueness The- 
orem, if x(t) is the solution of the initial value problem (2) on an 
interval J, prove that the second derivative x(t) is continuous on [. 


8. Prove that if f € C'(E) where E is a compact convex subset of R” 
then f satisfies a Lipschitz condition on E. Hint: Cf. Theorem 9.19 
in [R]. 


9. Prove that if f satisfies a Lipschitz condition on E then f is uniformly 
continuous on E. 


10. (a) Show that the function f(z) = 1/z is not uniformly continuous 
on & = (0,1). Hint: f is uniformly continuous on E if for all 
€ > 0 there exists a 6 > O such that for all z,y € E with 
|x — y| < 6 we have |f(z) — f(y)| < ¢. Thus, f is not uniformly 
continuous on E if there exists an ¢ > 0 such that for all 6 > 0 
there exist z,y € E with |x — y| < 6 such that |f(z) — f(y)| >. 
Choose € = 1 and show that for all 6 > O with 6 < 1,2 = 6/2 and 
y = 6 implies that z, y € (0,1), |z—y| < 6 and |f(x)— f(y)| > 1. 

(b) Show that f(z) = 1/z does not satisfy a Lipschitz condition on 


? 


11. Prove that if f is differentiable at xo then there exists a6 > 0 and a 
Ko > 0 such that for all x € Ng(xo) 


\f(x) — £(x0)| < Kolx — xol. 


2.3 Dependence on Initial Conditions and 
Parameters 


In this section we investigate the dependence of the solution of the initial 
value problem F(x) 
x = f(x 
x(0) =y ) 
on the initial condition y. If the differential equation depends on a param- 
eter p € R™, i.e., if the function f(x) in (1) is replaced by f(x, yz), then the 
solution u(t, y, 42) will also depend on the parameter yz. Roughly speaking, 
the dependence of the solution u(t, y, 4) on the initial condition y and 
the parameter p is as continuous as the function f. In order to establish 
this type of continuous dependence of the solution on initial conditions and 
parameters, we first establish a result due to T.H. Gronwall. 


Lemma (Gronwall). Suppose that g(t) is a continuous real valued function 
that satisfies g(t) > 0 and 


ot) <C+K [ o(s) as 
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for all t € (0, a] where C and K are positive constants. It then follows that 
for all t € (0, a], 
g(t) < Ce**. 


Proof. Let G(t) = C + K fy g(s) ds for t € (0,a]. Then G(t) > g(t) and 
G(t) > 0 for all t € (0,a]. It follows from the fundamental theorem of 
calculus that 
G'(t) = Kg(t) 

and therefore that 

Gt) _ Kalt) . KGW) 

G(t) G(t) ~ G() 
for all t € [0, a]. And this is equivalent to saying that 


= K 


d 
— < 
7 (08 G(t))<K 
or 
log G(t) < Kt + log G(0) 
or 
G(t) < G(0)e** = Ce** 
for all t € (0, a], which implies that g(t) < Ce for all t € (0, a]. 
Theorem 1 (Dependence on Initial Conditions).Let E be an open 
subset of R" containing xo and assume that f € C'(E). Then there ex- 


ists ana > 0 and a6 > 0 such that for all y € Ng(xo) the initial value 
problem 


x = f(x) 
x(0)=y 
has a unique solution u(t, y) with u € C!(G) where G = [—a, a] x Ng(x0) C 


R"+!. furthermore, for each y € Ng(Xo), u(t, y) ts a twice continuously 
differentiable function of t for t € [—a, a]. 


Proof. Since f € C1(E), it follows from the lemma in Section 2.2 that 
there is an e-neighborhood N,(xo) C E and a constant K > 0 such that 
for all x and y € N-(Xo), 


|f(x) — f(y)| < A|x—- yl. 


As in the proof of the fundamental existence theorem, let No = {x € R” | 
|x —x9| < €/2}, let Mo be the maximum of |f(x)| on No and let M, be the 
maximum of ||Df(x)|| on No. Let 6 = ¢/4, and for y € Ns(xo) define the 
successive approximations u,(t, y) as 


ug(t,y) =y 


ursil(t,y) =y+ i f(u,(s,y)) ds. 2) 
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Assume that u,(t, y) is defined and continuous for all (t, y) € G = [—a, a] x 
N6(xo) and that for all y € Ns(xo) 


jux(t, y) — Xo] < €/2 (3) 


where ||- || denotes the maximum over all t € [—a, a]. This is clearly satisfied 
for k = 0. And assuming this is true for k, it follows that u,x41(t, y), defined 
by the above successive approximations, is continuous on G. This follows 
since a continuous function of a continuous function is continuous and since 
the above integral of the continuous function f(u,(s,y)) is continuous in 
t by the fundamental theorem of calculus and also in y; cf. Rudin [R] or 
Carslaw [C]. We also have 


t 
llueaa(tsy) -yll < / If(ux(s,y))| ds < Moa 


for t € [—a,a] and y € Ng(xo) C No. Thus, for t € [—a,a] and y € N5(xo) 
with 6 = €/4, we have 


llux+i(t, ¥) — xoll < lluesi(t,y) — yll + lly — xoll 
< Moat+e/4<e/2 
provided Moa < €/4, i.e., provided a < €/(4Mo). Thus, the above induction 
hypothesis holds for all k = 1,2,3,... and (t, y) € G provided a < €/(4Mpo). 
We next show that the successive approximations u;,(t, y) converge uni- 


formly to a continuous function u(t, y) for all (t, y) € G as k — oo. As in 
the proof of the fundamental existence theorem, 


llue(t, y) =, uj (t, y)Il < Kallui(¢, y) = y|l 
< Kallui(t, y) — xol| + Kally — xoll 
< Ka(e/2+¢/4) < Kae 


for (t, y) € G. And then it follows exactly as in the proof of the fundamental 
existence theorem in Section 2.2 that 


llun+i(t, y) — ux(t,y)|| < (Ka)*e 


for (t, y) € G and consequently that the successive approximations converge 
uniformly to a continuous function u(t, y) for (t, y) € G as k — oo provided 
a < 1/K. Furthermore, the function u(t, y) satisfies 


t 
u(t,y) =y + / F(u(s,y)) ds 


for (t,y) € G and also u(0,y) = y. And it follows from the inequality 
(3) that u(t,y) € Nes2(xXo) for all (t,y) € G. Thus, by the fundamental 
theorem of calculus and the chain rule, it follows that 


u(t, y) = f(u(t,y)) 
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and that 

a(t, y) = Df(u(t, y))u(t, y) 
for all (t, y) € G; i.e., u(t, y) is a twice continuously differentiable function 
of t which satisfies the initial value problem (1) for all (t,y) € G. The 
uniqueness of the solution u(t, y) follows from the fundamental theorem in 
Section 2.2. 

We now show that u(t, y) is a continuously differentiable function of y 
for all (t, y) € [—a, a] x Ns/2(xo). In order to do this, fix yo € N5/2(xo) and 
choose h € R” such that |h| < 6/2. Then yo+h € Ng(xo). Let u(t, yo) and 
u(t, Yo + h) be the solutions of the initial value problem (1) with y = yo 
and with y = yo + h respectively. It then follows that 


lu(t, yo +h) — u(t, yo)| < [h| + / If(u(s, yo + h)) — £(u(s, yo))| ds 


t 
<thl+K f° |u(s,yo+h) — u(s,yo)lds 
0 
for all t € [—a, a]. Thus, it follows from Gronwall’s Lemma that 
u(t, yo + h) — u(t, yo)| < |hle*"! (4) 


for all t € [—a,a]. We next define B(t, yo) to be the fundamental matrix 
solution of the initial value problem 


= A(t, y 0)® 

#(0, y 0) =I 
with A(t, yo) = Df(u(t, yo)) and J the n x n identity matrix. The existence 
and continuity of ®(t, yo) on some interval [—a, a] follow from the method of 
successive approximations as in problem 4 of Problem Set 2 and problem 4 


in Problem Set 3. It then follows from the initial value problems for u(t, yo), 
u(t, yo + h) and ®(t, yo) and Taylor’s Theorem, 


f(u) — f(up) = Df(up)(u — uo) + R(u, uo) 
where |R(u, ug)|/|u — up| — 0 as |u — uo| — 0, that 


(5) 


lu(t, yo) — u(t, yo + h) + &(t, yo)h| < / If(u(s, yo)) 
~ £(u(s, yo + h)) + Df(u(s, yo))®(s, yo)h| ds 


< [ * WDE(u(s,yo))|Klu(s, yo) ~ ule, yo +h) + (2, yo)h| ds 
+ | " IR(u(s, yo +h), u(s, yo))| ds (6) 


Since |R(u, uo)|/|u—uo| + 0 as |u— up| — 0 and since u(s, y) is continuous 
on G, it follows that given any €9 > 0, there exists a dp > 0 such that if 
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|h| < 69 then |R(u(s, yo), u(s, yo + h))| < €o|u(s, yo) — u(s, yo + h)| for all 
s € [—a, a]. Thus, if we let 


g(t) = |u(t, yo) — u(t, Yo + h) + ®(t, yo)h| 
it then follows from (4) and (6) that for all t € [—a,a], yo € Ng2(xo) and 
|h| < min(5o, 6/2) we have 


t 
g(t) < My | g(s) ds + eo|hlaeX®, 
0 


Hence, it follows from Gronwall’s Lemma that for any given & > 0 
g(t) < eo|hlae**e™12 
for all t € [—a, a] provided |h| < min(5o, 6/2). Thus, 


im Udt¥o) — ult, Yo + h) + H(t, yo)h| _ 


0 


uniformly for all t € [—a,a]. Therefore, according to Definition 1 in Sec- 
tion 2.1, 


Fe tts¥o) = (t, yo) 


for all t € [—a,a] where ®(t, yo) is the fundamental matrix solution of the 
initial value problem (5) which is continuous in t and in yo for all t € [—a, a] 
and yo € Ns 2(Xo). This completes the proof of the theorem. 


Corollary. Under the hypothesis of the above theorem, 
Ou 
@(t,y) = —(t, 
(t,y) By | y) 


for t € [—a,a] and y € Ng(xo) if and only if ®(t,y) is the fundamental 
matriz solution of 


& = Df[u(t, y)|® 
$(0,y) =I 
for t € [-a,a] and y € Ng(Xxo). 


Remark 1. A similar proof shows that if f € C"’(E) then the solution 
u(t, y) of the initial value problem (1) is in C’(G) where G is defined as in 
the above theorem. And if f(x) is a (real) analytic function for x € E then 
u(t, y) is analytic in the interior of G; cf. [C/L)]. 
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Remark 2. If xo is an equilibrium point of (1), i.e., if f(xo) = 0 so that 
u(t, Xo) = Xo for all t € R, then 


ou 
satisfies 


© = Df(xo)® 
©(0,x9) = I. 


And according to the Fundamental Theorem for Linear Systems 
®(t,x9) = eDE(Xo)t, 


Remark 3. It follows from the continuity of the solution u(t, y) of the 
initial value problem (1) that for each t € [—a, a] 


i t = : 
wn. u(t, y) = u(t, xo) 


It follows from the inequality (4) that this limit is uniform for all t € [—a, a]. 
We prove a slightly stronger version of this result in Theorem 4 of the next 
section. 


Theorem 2 (Dependence on Parameters).Let E be an open subset of 
R"+™ containing the point (Xo0,[t9) where Xo € R” and pp € R™ and 
assume that f € C'(E). It then follows that there exists an a > 0 and 
a 6 > 0 such that for all y € Ng(xo) and pp € N6(po), the initial value 
problem 


x = f(x,y) 
x(0) =y 
has a unique solution u(t,y,) with u € C}(G) where G = [-a,a] x 
Ng(xo) x Ne(to). 


This theorem follows immediately from the previous theorem by replac- 
ing the vectors x9, x, x and y by the vectors (xo, Mo), (x, 4), (x,0) and 
(y, 44) or it can be proved directly using Gronwall’s Lemma and the method 
of successive approximations; cf. problem 3 below. 


PROBLEM SET 3 


1. Use the fundamental theorem for linear systems in Chapter 1 to solve 
the initial value problem 


x = Ax 
x(0) = y. 
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Let u(t, y) denote the solution and compute 


Ou 
@(t) = —(t,y). 
(t) = ay) 
Show that (t) is the fundamental matrix solution of 


6 = Ab 
(0) = I. 


2. (a) Solve the initial value problem 
x = f(x) 
x(0) =y 


for f(x) = (—21,—z2 + 22,23 + 22)?. Denote the solution by 
u(t, y) and compute 

ou 
Oy 


Compute the derivative Df(x) for the given function f(x) and 
show that for all t€ R and y € R?, ®(t, y) satisfies 


@(t,y) = (ty). 


& = A(t, y)® 
6(0,y) =/ 


where A(t, y) = Df[u(t, y)]. 


(b) Carry out the same steps for the above initial value problem 
with f(x) = (z?, 29 +27")?. 


3. Consider the initial value problem 


x = f(t, x, ps) 
x(0) = Xo. (*) 


Given that E is an open subset of R"*+™+*! containing the point 
(0, Xo, fo) where Xo € R” and py € R™ and that f and Of /Ox are 
continuous on £, use Gronwall’s Lemma and the method of successive 
approximations to show that there is an a > 0 and a 6 > 0 such that 
the initial value problem (*) has a unique solution u(¢, jz) continuous 
on [—a, a] x Ng( po). 


4. Let E be an open subset of R” containing yo. Use the method of 
successive approximations and Gronwall’s Lemma to show that if 
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A(t, y) is continuous on [—apo, ao] x E then there exist an a > 0 and 
a 6 > 0 such that for all y € Ns(yo) the initial value problem 


6 = A(t,y)® 
6(0,y) =] 
has a unique solution ®(¢, y) continuous on [—a, a] x Ns(yo). Hint: 


Cf. problem 4 in Problem Set 2 and regard y as a parameter as in 
problem 3 above. 


. Let ©(t) be the fundamental matrix solution of 


} = A(t) 


and the initial condition 


6(0) =1 


for t € (0, a]; cf. Problem 4 in Section 2. Use Liouville’s Theorem (cf. 
[H], p. 46), which states that 
t 
det 6(¢) = exp | trace A(s) ds, 
0 
to show that for all t € [0, a] 


det Fy (ts X0) = exp [ V - f(u(s, x9)) ds 


where u(t, y) is the solution of the initial value problem (1) as in the 
first theorem in this section. Hint: Use the Corollary in this section. 


. (Cf. Hartman [H], p. 96.) Let f € C'(E) where E is an open set in 


R” containing the point x9. Let u(t, yo) be the unique solution of 
the initial value problem (1) for t € (0, a] with y = yo. Show that the 
set of maps of yo — y defined by y = u(t, yo) for each fixed t € (0, a] 
are volume preserving in E if and only if V - f(x) = 0 for all x € E. 
Hint: Recall that under a transformation of coordinates y = u(x) 
which maps a region Ro one-to-one and onto a region A, the volume 
of the region FR is given by 


v= | se0der...de, 


where the Jacobian determinant 


J(x) = det s(x). 
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2.4 The Maximal Interval of Existence 


The fundamental existence-uniqueness theorem of Section 2.2 established 
that if f €¢ C'(£) then the initial value problem 


x = f(x) 
x(0) = Xo 


(1) 


has a unique solution defined on some interval (—a,a). In this section we 
show that (1) has a unique solution x(t) defined on a maximal interval of 
existence (a, @). Furthermore, if @ < oo and if the limit 


x, = lim x(t 
: t—8- (2) 


exists then x; € E, the boundary of E. The boundary of the open set 
E, E = E ~ E where E denotes the closure of E. On the other hand, if 
the above limit exists and x; € E, then @ = oo, f(x;) = 0 and x; is an 
equilibrium point of (1) according to Definition 1 in Section 2.6 below; cf. 
Problem 5. The following examples illustrate these ideas. 


Example 1 (Cf. Example 2 in Section 2.1).The initial value problem 
t=2% 2(0)=1 


has the solution z(t) = (1—t)—! defined on its maximal interval of existence 
(a, 8B) = (—oo, 1). Furthermore, jim. z(t) = 00. 


Example 2. The initial value problem 


z(0) =1 
has the solution z(t) = 1 — t defined on its maximal interval of existence 
(a, B) = (—0o, 1). The function f(z) = —1/(2z2) € C'(E) where E = (0, 00) 
and EF = {0}. Note that 
jim z(t) =0€ E. 


Example 3. Consider the initial value problem 


Zt) = “a 
: T} 
t2 = za 
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with x(1/7) = (0, —1,1/7)?. The solution is 


X3 


{ 
(0,-1, >=) 
Xo 


SZ | 


Figure 1. The solution x(t) for Example 3. 


sin 1/t 
x(t) = co i" 
t 


on the maximal interval (a, 3) = (0, 00). Cf. Figure 1. At the finite endpoint 
a= 0, lim, x(t) does not exist. Note, however, that the arc length 
t— 


[ (rier > | —— AD ar = ff id eee 
l/x - l/n 23(r) l/n Ts t 


as t + Ot. Cf. Problem 3. 


We next establish the existence and some basic properties of the maximal 
interval of existence (a, 3) of the solution x(t) of the initial value problem 


(1). 
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Lemma 1. Let E be an open subset of R” containing xo and suppose 
f € C)(E). Let u,(t) and uo(t) be solutions of the initial value problem (1) 
on the intervals I; and Ig. Then0 € 1; N Iq and if I is any open interval 
containing 0 and contained in I, N Io, it follows that u(t) = ue(t) for all 
tel. 


Proof. Since u;(t) and ue(t) are solutions of the initial value problem (1) 
on J; and I respectively, it follows from Definition 1 in Section 2.2 that 
0 € 1; NIg. And if J is an open interval containing 0 and contained in 
I, N Ig, then the fundamental existence-uniqueness theorem in Section 2.2 
implies that u,(t) = u2(t) on some open interval (—a,a) C J. Let I* be 
the union of all such open intervals contained in J. Then /* is the largest 
open interval contained in J on which u;(t) = uo(t). Clearly, J* Cc J and if 
I* is a proper subset of J, then one of the endpoints to of J* is contained 
in JC I; NIo. It follows from the continuity of u,(t) and ug(t) on J that 


i t) = li t). 
jim u; (¢) jim u(t) 


Call this common limit uo. It then follows from the uniqueness of solutions 
that u,(t) = ue(t) on some interval Ip = (to — a,tp + a) C J. Thus, 
u;(t) = u2(t) on the interval J* U Jpg C J and J* is a proper subset of 
I* UI. But this contradicts the fact that J* is the largest open interval 
contained in J on which u,(t) = uo(t). Therefore, /* = J and we have 
u;(t) = ug(t) for all t € I. 


Theorem 1. Let E be an open subset of R" and assume that f € C!(E). 
Then for each point xo € E, there is a maximal interval J on which the 
initial value problem (1) has a unique solution, x(t); t.e., if the initial value 
problem has a solution y(t) on an interval I then I Cc J and y(t) = x(t) 
for allt € I. Furthermore, the mazimal interval J is open; t.e., J = (a, B). 


Proof. By the fundamental existence-uniqueness theorem in Section 2.2, 
the initial value problem (1) has a unique solution on some open interval 
(—a,a). Let (a, @) be the union of all open intervals J such that (1) has 
a solution on J. We define a function x(t) on (a, G) as follows: Given t € 
(a, GB), t belongs to some open interval J such that (1) has a solution u(t) 
on I; for this given t € (a, 8), define x(t) = u(t). Then x(t) is a well-defined 
function of t since if t € [; NJ_ where J; and Jo are any two open intervals 
such that (1) has solutions u;(t) and ug(t) on J; and J2 respectively, then 
by the lemma u;(t) = ug(t) on the open interval J; N J2. Also, x(t) is a 
solution of (1) on (a, @) since each point t € (a, 8) is contained in some 
open interval J on which the initial value problem (1) has a unique solution 
u(t) and since x(t) agrees with u(t) on J. The fact that J is open follows 
from the fact that any solution of (1) on an interval (a, @] can be uniquely 
continued to a solution on an interval (a, @ +a) with a > 0 as in the proof 
of Theorem 2 below. 
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Definition. The interval (a, 3) in Theorem 1 is called the mazimal interval 
of existence of the solution x(t) of the initial value problem (1) or simply 
the maximal interval of existence of the initial value problem (1). 


Theorem 2. Let E be an open subset of R" containing xo, let f € C'(E), 
and let (a, 8) be the mazimal interval of existence of the solution x(t) of 
the initial value problem (1). Assume that B < oo. Then given any compact 
set K C E, there exists a t € (a, 8) such that x(t) ¢ K. 


Proof. Since f is continuous on the compact set K, there is a positive 
number M such that |f(x)| < M for all x € K. Let x(t) be the solution 
of the initial value problem (1) on its maximal interval of existence (a, ) 
and assume that @ < oo and that x(t) € K for all t € (a, @). We first show 
that fa x(t) exists. If a < t; < te < @ then 


Ix(ts) — x(ta)| < / " |£(x(s))| ds < Mit, — ty. 


Thus as t,; and t2 approach @ from the left, |x(t2) — x(t;)| — 0 which, by 
the Cauchy criterion for convergence in R® (i.e., the completeness of R™) 
implies that jm x(t) exists. Let x; = jim x(t). Then x; € K C E since 


K is compact. Next define the function u(t) on (a, 6] by 


x(t) for t€(a,B) 
MS: - for t=f8. 


Then u(t) is differentiable on (a, 6]. Indeed, 


u(t) = X9 + re f(u(s)) ds 


which implies that 
u’(8) = f(u(A)); 


i.e., u(t) is a solution of the initial value problem (1) on (a, (]. The function 
u(t) is called the continuation of the solution x(t) to (a, 6]. Since x; € E, it 
follows from the fundamental existence-uniqueness theorem in Section 2.2 
that the initial value problem x = f(x) together with x(@) = x; has a 
unique solution x,(t) on some interval (G — a, 8+ a). By the above lemma, 
x;(t) = u(t) on (8 —a, @) and x;(@) = u(@) = x;. So if we define 


u(t) for t€ (a, 
A a ee for t€ (8,8 +a), 


then v(t) is a solution of the initial value problem (1) on (a, 8+ a). But 
this contradicts the fact that (a, @) is the maximal interval of existence for 
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the initial value problem (1). Hence, if 8 < 00, it follows that there exists 
a t € (a, G) such that x(t) ¢ K. 

If (a, 8B) is the maximal interval of existence for the initial value problem 
(1) then 0 € (a, ) and the intervals (0, 8) and (a, 0] are called the right 
and left maximal intervals of existence respectively. Essentially the same 
proof yields the following result. 


Theorem 3. Let E be an open subset of R” containing xo, let f € C'(E), 
and let [0, 8) be the right maximal interval of existence of the solution x(t) 
of the initial value problem (1). Assume that B < oo. Then given any 
compact set K C E, there exists at € (0,8) such that x(t) ¢ K. 


Corollary 1. Under the hypothesis of the above theorem, if B < oo and if 
pave x(t) exists then im x(t) € E. 


Proof. If x; = jim x(t), then the function 


ail) = om for te (0, ) 


X) for t=, 


is continuous on (0, 6]. Let K be the image of the compact set (0, 6] under 
the continuous map u(t); i-e., 


K = {x € R" |x = u(t) for some t € (0, 6}. 


Then K is compact. Assume that x; € E. Then K C E and it follows 
from Theorem 3 that there exists a t € (0, @) such that x(t) ¢ K. This is a 
contradiction and therefore x, ¢ E. But since x(t) € E for all t € (0,8), it 
follows that x; = im x(t) € E. Therefore x; € E ~ E; i.e., x, € E. 


Corollary 2. Let E be an open subset of R" containing xo, let f € C'(E), 
and let [0,G) be the right marimal interval of existence of the solution x(t) 
of the initial value problem (1). Assume that there exists a compact set 
K CE such that 


{yéR"|y=x(t) forsome te [0,8)} Cc K. 


It then follows that B = ov; 1.e. the initial value problem (1) has a solution 
x(t) on [0, 00). 


Proof. This corollary is just the contrapositive of the statement in Theo- 
rem 3. 


We next prove the following theorem which strengthens the result on 
uniform convergence with respect to initial conditions in Remark 3 of Sec- 
tion 2.3. 
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Theorem 4. Let E be an open subset of R" containing xo and let f € 
C!(E). Suppose that the initial value problem (1) has a solution x(t, xo) 
defined on a closed interval [a,b]. Then there exists a 6 > 0 and a positive 
constant K such that for all y € Ns(xo) the initial value problem 


x = f(x) 
x(0) =y 


has a unique solution x(t, y) defined on [a,b| which satisfies 


(2) 


|x(t, y) — x(t, xo)| < ly — xole*'#! 


and 
yim x(t, y) = x(t, Xo) 


uniformly for all t € [a, b}. 


Remark 1. If in Theorem 4 we have a function f(x, ys) depending on a 
parameter pp € R™ which satisfies f € C'(E) where E is an open subset 
of R"*™ containing (xo, 49), it can be shown that if for pp = po the initial 
value problem (1) has a solution x(t, xo, f49) defined on a closed interval 
a<t<_b, then there is a 6 > 0 and a K > 0 such that for all y € Ng(xo) 
and pp € Ng(f1o) the initial value problem 


x = F(x, 1) 
x(0) =y 
has a unique solution x(t, y, 42) defined for a < t < 6 which satisfies 


and 


lim x(t, y, 2) = x(t, Xo, 
if) Tete) (t, y, 4) = x(t, Xo, Mo) 


uniformly for all t € (a, b]. Cf. [C/L], p. 58. 
In order to prove this theorem, we first establish the following lemma. 


Lemma 2. Let E be an open subset of R" and let A be a compact subset of 
E. Then if f: E — R” is locally Lipschitz on E, it follows that f satisfies 
a Lipschitz condition on A. 


Proof. Let M be the maximal value of the continuous function f on the 
compact set A. Suppose that f does not satisfy a Lipschitz condition on A. 
Then for every K > 0, we can find x,y € A such that 


lf(y) — f(x)| > Kly — xl. 
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In particular, there exist sequences x, and y,, in A such that 


If(Yn) — £(Xn)| > nlyn — Xnl (*) 


for n = 1,2,3,.... Since A is compact, there are convergent subsequences, 
call them x, and y, for simplicity in notation, such that x, — x* and 
Yn — y* with x* and y® in A. It follows that x* = y”* since for all n = 
1 233325 


1 2M 
*“—x*|= li n—Xn| S- n}) — n)| S —. 
ly” — x°| = lim lyn — Xnl S = [f(¥n) — F(xn)| S — 


Now, by hypotheses, there exists a neighborhood No of x* and a constant 
Ko such that f satisfies a Lipschitz condition with Lipschitz constant Ko 
for all x and y € No. But since x, and y, approach x* as n — oo, it follows 
that x, and y,, are in No for n sufficiently large; i.e., for n sufficiently large 


lf(yn) — £(Xn)| < Alyn — Xn. 


But for n > K, this contradicts the above inequality (*) and this establishes 
the lemma. 


Proof (of Theorem 4). Since [a, b] is compact and x(t, xo) is a continuous 
function of t, {x € R” | x = x(t,xo) and a < t < b} is a compact subset of 
E. And since E is open, there exists an € > 0 such that the compact set 


A= {xe R" | |x — x(t,xo0)| <¢ anda<t <b} 


is a subset of E. Since f € C!(E), it follows from the lemma in Section 2.2 
that f is locally Lipschitz in E; and then by the above lemma, f satisfies a 
Lipschitz condition 
lf(y) — f(x)| < Kly — x| 

for all x,y € A. Choose 6 > 0 so small that 6 < ¢ and 6 < ce~* (6-9), Let 
y € Ng(xo) and let x(t, y) be the solution of the initial value problem (2) on 
its maximal interval of existence (a, 8). We shall show that [a,b] C (a, £). 
Suppose that B < b. It then follows that x(t,y) € A for all t € (a,f) 
because if this were not true then there would exist a t* € (a, @) such that 
x(t,xX9) € A for t € (a, t*] and x(t*, y) € A. But then 


Ix(t, y) — x¢(¢,x0)1 < ly — xol + | If(x(s, y)) — f(x(s, x0) | ds 


t 
< ly - x0] + K i Ix(s, y) — x(s, x0) | ds 


for all t € (a, t*]. And then by Gronwall’s Lemma in Section 2.3, it follows 
that 


|x(t*, y) — x(t", xo)| < ly — xole*!! < be* O° < c 
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since t* < B < b. Thus x(t*, y) is an interior point of A, a contradiction. 
Thus, x(t, y) € A for all t € (a, G). But then by Theorem 2, (a, 8) is not 
the maximal interval of existence of x(t, y), a contradiction. Thus b < £. 
It is similarly proved that a < a. Hence, for all y € N6(xo), the initial 
value problem (2) has a unique solution defined on [a,b]. Furthermore, if 
we assume that there is a t* € (a,b) such that x(t, y) € A for all t € [a, t*) 
and x(t*,y) € A, a repeat of the above argument based on Gronwall’s 
Lemma leads to a contradiction and shows that x(t, y) € A for all ¢ € [a, } 


and hence that 


Ix(t,y) — x(t, xo) < ly — xole! 


for all t € (a, b]. It then follows that 


gous x(t, y) = x(t, Xo) 


uniformly for all t € [a, }. 


PROBLEM SET 4 


1. Find the maximal interval of existence (a, @) for the following initial 
value problems and if a > —oo or 8 < oo discuss the limit of the 
solution as t — at or as t — B~ respectively: 


(a) aa a : 

(b) ie 5 
(c) i 2 7 “ 
@ sQyzay>0 


(e) Problem 2(b) in Problem Set 3 with y; > 0. 


2. Find the maximal interval of existence (a, 3) for the following initial 
value problems and if a > —oo or B < oo discuss the limit of the 
solution as t + at or as t — G~ respectively: 


(a) Ly = x 2;(0) =] 


fg=22+2;' 22(0)=1 


. _ 
(b) 71 = 92, 2z,(0) =1 


to = 23 z2(0) =1 
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(c) Ly = = 2, (0) =1 


Xo = 7) £2(0) =1 


3. Let f € C'(E) where E is an open set in R” containing the point 
Xo and let x(t) be the solution of the initial value problem (1) on its 
maximal interval of existence (a, 8). Prove that if 6 < oo and if the 
arc-length of the half-trajectory [, = {x € R"” |x = x(t),0 <t < B} 
is finite, then it follows that the limit 


x; = lim x(t 
1 = lim x(t 


exists. Then by Corollary 1, x, € &. Hint: Assume that the above 
limit does not exist. This implies that there is a sequence t,, converg- 
ing to @ from the left such that x(t,) is not Cauchy. Use this fact to 
show that the arc-length of ['s is then unbounded. 


4. Convert the system in Example 3 to cylindrical coordinates, (r, 6, z) 
as in Problem 9 in Section 1.5 of Chapter 1, and solve the resulting 
system with the initial conditions r = 1, 9 = —7, z = 1/m at t = 0. 
What is the maximal interval of existence in this case? 

5. Use Corollary 2 to show that if x; = hae x(t) exists and x; € E, 


then 8 = oo; and then show that f(x,) = 0 and note that x(t) = x; 
is a solution of (1) and x(0) = x). 


2.5 The Flow Defined by a Differential Equation 


In Section 1.9 of Chapter 1, we defined the flow, e“*: R" — R", of the 
linear system 
x = Ax. 


The mapping ¢, = e“* satisfies the following basic properties for all x € 
R”: 


(i) o(x) =x 
(ii) $,(,(x)) = $542(X) for all 8,t€ R 
(iii) b_e(b_(x)) = b,(P_2(x)) = x for all t€ R. 


Property (i) follows from the definition of e“*, property (ii) follows from 
Proposition 2 in Section 1.3 of Chapter 1, and property (iii) follows from 
Corollary 2 in Section 1.3 of Chapter 1. 

In this section, we define the flow, ¢,, of the nonlinear system 


& = f(x) (1) 
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and show that it satisfies these same basic properties. In the following 
definition, we denote the maximal! interval of existence (a, 3) of the solution 
(t, Xo) of the initial value problem 


x = f(x) 
x(0) = xo 


(2) 


by I(x) since the endpoints a and ( of the maximal interval generally 
depend on xq; cf. problems 1(a) and (d) in Section 2.4. 


Definition 1. Let E be an open subset of R” and let f € C!(E). For 
Xo € E, let $(t, xo) be the solution of the initial value problem (2) defined 
on its maximal interval of existence [(xo). Then for ¢ € I(x), the set of 
mappings @, defined by 
$,(X0) = P(t, Xo) 

is called the flow of the differential equation (1) or the flow defined by the 
differential equation (1); @, is also referred to as the flow of the vector field 
f(x). 

If we think of the initial point x9 as being fixed and let J = I(xo), 
then the mapping ¢(-,Xo): J — E defines a solution curve or trajectory of 
the system (1) through the point xo € E. As usual, the mapping ¢$(-, xo) 
is identified with its graph in J x E and a trajectory is visualized as a 
motion along a curve I through the point xo in the subset E of the phase 
space R”; cf. Figure 1. On the other hand, if we think of the point xo as 
varying throughout K C E, then the flow of the differential equation (1), 
o,: K — E can be viewed as the motion of all the points in the set K; cf. 
Figure 2. 


Figure 1. A trajectory I of the Figure 2. The flow @, of the 
system (1). system (1). 
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If we think of the differential equation (1) as describing the motion of a 
fluid, then a trajectory of (1) describes the motion of an individual particle 
in the fluid while the flow of the differential equation (1) describes the 
motion of the entire fluid. 

We now show that the basic properties (i)-(iii) of linear flows are also 
satisfied by nonlinear flows. But first we extend Theorem 1 of Section 2.3, 
establishing that $(t, xo) is a locally smooth function, to a global result. 
Using the same notation as in Definition 1, let us define the set QC Rx E 
as 


Q = {(t,x9) Ee Rx E|t € I(xo)}. 
Example 1. Consider the differential equation 


1 


M 


x 


with f(r) = 1/z € C'(E) and E = {x € R| z > O}. The solution of this 
differential equation and initial condition r(0) = zo is given by 


(t,r0) = \/ 2t + 22 


on its maximal interval of existence [(x9) = (—13/2, 00). The region 2 for 
this problem is shown in Figure 3. 


2) 


o dA 


x< 
@) 
" 
1 
2 


Figure 3. The region 2. 


Theorem 1. Let E be an open subset of R" and let f € C'(E). Then Q 
is an open subset of R x E and @€ C!(N). 


Proof. If (to,xo9) € 2 and to > 0, then according to the definition of the 
set 0, the solution x(t) = O(t, Xo) of the initial value problem (2) is defined 
on [0, to]. Thus, as in the proof of Theorem 2 in Section 2.4, the solution 
x(t) can be extended to an interval (0, tg + €] for some € > 0; i.e., H(t, Xo) is 
defined on the closed interval [to — €, to + €]. It then follows from Theorem 4 
in Section 2.4 that there exists a neighborhood of x9, Ns(xo), such that 
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$(t, y) is defined on [to —€, to +e] x Ng (Xo); i.e., (to—€, to+e) x Ng(x0) C 2. 
Therefore, 2 is open in R x E. It follows from Theorem 4 in Section 2.4 
that @ € C!(G) where G = (tp — €, to + €) x No(xo). A similar proof holds 
for to < 0, and since (to,xo) is an arbitrary point in 2, it follows that 
¢g€eC'(Q). 


Remark. Theorem 1 can be generalized to show that if f € C"(E) with 
r > 1, then ¢@ € C7(Q) and that if f is analytic in E, then @ is analytic in 
Q. 


Theorem 2. Let E be an open set of R” and let f € C'(E). Then for all 
xo € E, if t € I(xo) and s € I(,(xXo)), it follows that s+t € I(x) and 


Po+t(Xo) ao $,(9;(Xo)). 


Proof. Suppose that s > 0, t € (xo) and s € I(¢,(xo)). Let the maximal 
interval I(x) = (a, @) and define the function x: (a,s +t] — E by 


_ £(r, Xo) ifa<r<t 
=e Ay —t,,(X0)) ift<r<s+t. 


Then x(r) is a solution of the initial value problem (2) on (a, s + ¢]. Hence 
s+te€ I(xo) and by uniqueness of solutions 


Po4t(Xo) = xX(3 +t) = H(s, $:(x0)) = O,(H,(X0)). 


If s = 0 the statement of the theorem follows immediately. And if s < 0, 
then we define the function x: [s + t, 8) — E by 


_ [4(75%6) ft<r<p 
Ula = ~t,,(Xo)) ifstt<r<t. 


Then x(r) is a solution of the initial value problem (2) on ([s+¢, @) and the 
last statement of the theorem follows from the uniqueness of solutions as 
above. 


Theorem 3. Under the hypotheses of Theorem 1, if (t, xo) € Q then there 
exists a neighborhood U of xo such that {t} x U C 2. It then follows that 
the set V = d,(U) is open in E and that 


b_.(%,(x)) =x for allx EU 


and 
$,(¢_.(y)) = y for ally € V. 


Proof. If (t, xo) € 2 then if follows as in the proof of Theorem 1 that there 
exists a neighborhood of x9, U = Ng(xo), such that (t{—e,t +e) xU CQ; 
thus, {t} x U c Q. For x € U, let y = ¢,(x) for all ¢ € I(x). Then 
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—t € I(y) since the function h(s) = $(s + t,y) is a solution of (1) on 
(—t, 0] that satisfies h(—t) = y; i.e., @_, is defined on the set V = @,(U). 
It then follows from Theorem 2 that _,(,(x)) = @9(x) = x for allx €e U 
and that $,(@_,(y)) = @o(y) = y for all y € V. It remains to prove that V 
is open. Let V* > V be the maximal subset of E on which @_, is defined. 
V* is open because 2 is open and @_,: V* — E is continuous because by 
Theorem 1, ¢ is continuous. Therefore, the inverse image of the open set U 
under the continuous map @_.,, i.e., @,(U), is open in E. Thus, V is open 
in E. 

In Chapter 3 we show that the time along each trajectory of (1) can be 
rescaled, without affecting the phase portrait of (1), so that for all xo € E, 
the solution @(t, xo) of the initial value problem (2) is defined for all t € R; 
i.e., for all x9 € E,1(x9) = (—00, 00). This rescaling avoids some of the 
complications found in stating the above theorems. Once this rescaling has 
been made, it follows that Q = R x E,g@e C!(R x E),¢, € C'(E) for all 
t € R, and properties (i)-(iii) for the flow of the nonlinear system (1) hold 
for all t € R and x € E just as for the linear flow e“*. In the remainder of 
this chapter, and in particular in Sections 2.7 and 2.8 of this chapter, it will 
be assumed that this rescaling has been made so that for all xo € E, O(t, xo) 
is defined for all t € R; i.e., we shall assume throughout the remainder of 
this chapter that the flow of the nonlinear system (1) ¢, € C'(£) for all 
teR. 


Definition 2. Let E be an open subset of R”, let f € C'(E), and let 
o,: E — E be the flow of the differential equation (1) defined for all 
t € R. Then a set SC E is called invariant with respect to the flow @, if 
,(S) C S for all t¢ € R and S is called positively (or negatively) invariant 
with respect to the flow ¢, if @,(S) C S for all ¢ > 0 (or t < 0). 

In Section 1.9 of Chapter 1 we showed that the stable, unstable and 
center subspaces of the linear system x = Ax are invariant under the linear 
flow ¢, = e“*. A similar result is established in Section 2.7 for the nonlinear 
flow @, of (1). 


Example 2. Consider the nonlinear system (1) with 


= Laat 


The solution of the initial value problem (1) together with the initial con- 
dition x(0) = c is given by 


ce" 
$.(c) = o(t,¢) = ae dies a | 
We now show that the set 
S = {x € R? | 22 = —2?/3} 
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is invariant under the flow @,. This follows since if c € S then cp = —c?/3 
and it follows that 


ce" 
b(e)=| a -n| €S 
Thus $,(S) C S for all ¢ € R. The phase portrait for the nonlinear system 


(1) with f(x) given above is shown in Figure 4. The set S is called the 
stable manifold for this system. This is discussed in Section 2.7. 


Xo 


x 


Figure 4. The invariant set S for the system (1). 


PROBLEM SET 5 
1. As in Example 1, sketch the region Q in the (¢, zo) plane for the initial 
value problem 


t=2" 


z(0) = Zo. 


2. Do problem 1 for the initial value problem 
z= 2° 


z(0) = zo. 


3. Sketch the flow for the linear system x = Ax with 


mes 
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and, in particular, describe (with a rough sketch) what happens to a 
small neighborhood N,(xo) of a point x9 on the negative x1-axis, say 
N,(—3,0) with ¢ = .2. (Cf. Figure 1 in Section 1.1 of Chapter 1.) 


4. Sketch the flow for the linear system x = Ax with 


-1 -3 
a-[o 
and describe @,(N.-(x0)) for x9 = (—3,0), € = .2. (Cf. Figure 2 in 


Section 1.2 of Chapter 1.) 


5. Determine the flow ¢,: R? — R? for the nonlinear system (1) with 


00 tad 


Qro + 2? 


and show that the set S = {x € R? | zo = —x?/4} is invariant with 
respect to the flow @,. 


6. Determine the flow ¢,: R* — R3 for the nonlinear system (1) with 
f(x) = -s + 4 
z3 + x? 


and show that the set S = {x € R? | z3 = —x?/3} is invariant 
under the flow @,. Sketch the parabolic cylinder S. (Cf. Example 1 
in Section 2.7.) 


7. Determine the flow ¢,: R ~ {0} — R for 
1 


-=— 
r2 


and for xo # 0 determine the maximal interval of existence I(xo) = 
(a, 3). If a > —00 or B < co show that 


slim, $4(20) € E or lim (20) € E 
where E = R ~ {0}. Sketch the set 2 = {(t, 20) € R? | t € I(z0)}. 
Show that $,(¢,(Zo)) = $:4,(o) for s € I(zo) and s +t € I(z9). 
2.6 Linearization 


A good place to start analyzing the nonlinear system 


x = f(x) (1) 
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is to determine the equilibrium points of (1) and to describe the behavior 
of (1) near its equilibrium points. In the next two sections it is shown that 
the local behavior of the nonlinear system (1) near a hyperbolic equilibrium 
point Xo is qualitatively determined by the behavior of the linear system 


x = Ax, (2) 


with the matrix A = Df(xo), near the origin. The linear function Ax = 
Df(xo)x is called the linear part of f at xo. 


Definition 1. A point x9 € R” is called an equilibrium point or critical 
point of (1) if f(x9) = 0. An equilibrium point x9 is called a hyperbolic 
equilibrium point of (1) if none of the eigenvalues of the matrix Df(xo) 
have zero real part. The linear system (2) with the matrix A = Df(xo) is 
called the linearization of (1) at xo. 

If x9 = O is an equilibrium point of (1), then f(0) = O and, by Taylor’s 
Theorem, 


f(x) = Df(0)x + 5 D°E(0)(x, aes 


It follows that the linear function Df(0)x is a good first approximation 
to the nonlinear function f(x) near x = 0 and it is reasonable to expect 
that the behavior of the nonlinear system (1) near the point x = 0 will be 
approximated by the behavior of its linearization at x = 0. In Section 2.7 
it is shown that this is indeed the case if the matrix Df(0) has no zero or 
pure imaginary eigenvalues. 

Note that if xo is an equilibrium point of (1) and ¢,: E — R” is the flow 
of the differential equation (1), then @,(xo) = Xo for all t € R. Thus, xo is 
called a fixed point of the flow @,; it is also called a zero, a critical point, 
or a singular point of the vector field f: E — R". We next give a rough 
classification of the equilibrium points of (1) according to the signs of the 
real parts of the eigenvalues of the matrix Df(xo). A finer classification is 
given in Section 2.10 for planar vector fields. 


Definition 2. An equilibrium point x9 of (1) is called a sink if all of the 
eigenvalues of the matrix Df(xo) have negative real part; it is called a 
source if all of the eigenvalues of Df(xo) have positive real part; and it 
is called a saddle if it is a hyperbolic equilibrium point and Df(x9) has 
at least one eigenvalue with a positive real part and at least one with a 
negative real part. 


Example 1. Let us classify all of the equilibrium points of the nonlinear 
system (1) with 


2 ie. 
ro= [FE 
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Clearly, f(x) = 0 at x = (1,0)? and x = (—1,0)7 and these are the only 
equilibrium points of (1). The derivative 


Df (x) = 7 eo ,Df(1,0) = 0 | ) 


and 


Df(-1,0) = 7 | 


Thus, (1,0) is a source and (—1,0) is a saddle. 


In Section 2.8 we shall see that if x9 is a hyperbolic equilibrium point 
of (1) then the local behavior of the nonlinear system (1) is topologically 
equivalent to the local behavior of the linear system (2); i.e., there is a 
continuous one-to-one map of a neighborhood of xg onto an open set U 
containing the origin, H: N.(xo) — U, which transforms (1) into (2), maps 
trajectories of (1) in N.(x9) onto trajectories of (2) in the open set U, and 
preserves the orientation of the trajectories by time, i.e., H preserves the 
direction of the flow along the trajectories. 


Example 2. Consider the continuous map 


which maps R? onto R?. It is not difficult to determine that the inverse of 
Pp 


y = H(x) is given by 
Hy) =| é ] 


y 
y2—- > 


and that H~! is a continuous mapping of R? onto R?. Furthermore, the 
mapping H transforms the nonlinear system (1) with 


a ae ie ‘| 


into the linear system (2) with 


A= Df(0) = € | 


in the sense that if y = H(x) then 
r= [ans foul ~ on est fev-ou] “| oa 
y Lo + 232) Za + x? + 223 (—2;) yo\’ 


__ f-1 0 
20: 1 
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We have used the fact that x = H~'(y) implies that x; = y, and z2 = 
y2 — y?/3 in obtaining the last step of the above equation for y. The phase 
portrait for the nonlinear system in this example is given in Figure 4 of 
Section 2.5 and the phase portrait for the linear system in this example is 
given in Figure 1 of Section 1.5 of Chapter 1. These two phase portraits 
are qualitatively the same. 


PROBLEM SET 6 


1. Classify the equilibrium points (as sinks, sources or saddles) of the 
nonlinear system (1) with f(x) given by 


ZI} — 7172 
a 
ro — x? 


—4r9 + 22,22 —8 
Sl rere 


22) = 22122 
(c) Qro — 2? + 23 


(d) |—z2 + x? 
3+ x 
I2— 2} 
(e) | kx, — rq — 2173}. 
Z\I2 — 73 
Hint: In 1(e), the origin is a sink if k < 1 and a saddle if k > 1. It is 
a nonhyperbolic equilibrium point if k = 1. 


2. Classify the equilibrium points of the Lorenz equation (1) with 


ee 
f(x) = |r) — 22-2173 
T\22 — 13 


for u > 0. At what value of the parameter yz do two new equilibrium 
points “bifurcate” from the equilibrium point at the origin? Hint: For 
pt > 1, the eigenvalues at the nonzero equilibrium points are 4 = —2 


and A = (-1+ /5 — 4p)/2. 
3. Show that the continuous map H: R? — R® defined by 
LT} 
H(x) = |22+27 
2 
73+ = 
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has a continuous inverse H~'!: R* — R® and that the nonlinear 
system (1) with 
—2) 
f(x) = |—-Zo+ x 
3+ x? 
is transformed into the linear system (2) with A = Df(O) under this 
map; i.e., if y = H(x), show that y = Ay. 


2.7 The Stable Manifold Theorem 


The stable manifold theorem is one of the most important results in the lo- 
cal qualitative theory of ordinary differential equations. The theorem shows 
that near a hyperbolic equilibrium point x9, the nonlinear system 


x = f(x) (1) 


has stable and unstable manifolds S and U tangent at xo to the stable and 
unstable subspaces E* and E” of the linearized system 


x = Ax (2) 


where A = Df(xo). Furthermore, S and U are of the same dimensions as 
E* and E”, and if @, is the flow of the nonlinear system (1), then S and 
U are positively and negatively invariant under @, respectively and satisfy 


jim. ,(c) = Xo for allc Ee S 


and 
; lim | ,(c) = Xo for all c € U. 


We first illustrate these ideas with an example and then make them 
more precise by proving the stable manifold theorem. It is assumed that 
the equilibrium point x9 is located at the origin throughout the remainder 
of this section. If this is not the case, then the equilibrium point xo can 
be translated to the origin by the affine transformation of coordinates x — 
X — Xo. 


Example 1. Consider the nonlinear system 
zy =-TZ) 
tq = -29 + x 


3 =213+ 27. 
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The only equilibrium point of this system is at the origin. The matrix 


-1 0 0 
A=Df(0)=]| 0 -1 O|. 
0 oO 1 
Thus, the stable and unstable subspaces E* and E™ of (2) are the 2), 22 
plane and the z3-axis respectively. After solving the first differential equa- 
tion, £; = —z,, the nonlinear system reduces to two uncoupled first-order 
linear differential equations which are easily solved. The solution is given 
by 
z(t) = ce‘ 
ro(t) = cge~* + c?(e* — e7**) 


23(t) = cge’ + Sie — et) 
where c = x(0). Clearly, jim d,(c) = 0 iff cz + c?/3 = 0. Thus, 
S = {c € R? | cg = —c?/3}. 
Similarly, jim. @,(c) = 0 iff c, = co = O and therefore 


U = {c € R?|c, = co = 0}. 


The stable and unstable manifolds for this system are shown in Figure 1. 
Note that the surface S is tangent to E*, i.e., to the z,,22 plane at the 
origin and that U = E”. 


X3 


Figure 1 


Before proving the stable manifold theorem, we first define the concept 
of a smooth surface or differentiable manifold. 
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Definition 1. Let X be a metric space and let A and B be subsets of 
X. A homeomorphism of A onto B is a continuous one-to-one map of A 
onto B, h: A — B, such that h~!: B — A is continuous. The sets A 
and B are called homeomorphic or topologically equivalent if there is a 
homeomorphism of A onto B. If we wish to emphasize that h maps A onto 
B, we write h:A & B. 


Definition 2. An n-dimensional differentiable manifold, M (or a manifold 
of class C*), is a connected metric space with an open covering {U4}, i.e., 
M =U, Va, such that 


(1) for all a, U, is homeomorphic to the open unit ball in R", B = {x € 
R” | |x| < 1}, i-e., for all a there exists a homeomorphism of U, onto 
B,ha: U. — B, and 


(2) if U.NUg #9 and hg: U, — B,hg: Ug — B are homeomorphisms, 
then ha(U, Ug) and hg(U,M Ug) are subsets of R” and the map 


h = hg ohj?!: hg(Ua Ug) > ha(Ua MU) 


is differentiable (or of class C*) and for all x € hg(U, Us), the 
Jacobian determinant det Dh(x) # 0. The manifold M is said to be 
analytic if the maps h = hg oh;" are analytic. 


The cylindrical surface S in the above example is a two-dimensional dif- 
ferentiable manifold. The projection of the z),22 plane onto S maps the 
unit disks centered at the points (m,n) in the 1, z2 plane onto homeomor- 
phic images of the unit disk B = {x € R? | 2? + 23 < 1}. These sets 
Umn C S then form a countable open cover of S in this case. 

The pair (U,,hq) is called a chart for the manifold M and the set of 
all charts is called an atlas for M. The differentiable manifold M is called 
orientable if there is an atlas with detDh, o h;'(x) > 0 for all a, 8 and 
x € hg(U, N Ug). Cf. Problems 7 and 8. 


Theorem (The Stable Manifold Theorem). Let E be an open subset of 
R®” containing the origin, let f € C'(E), and let d, be the flow of the non- 
linear system (1). Suppose that £(0) = 0 and that Df(0) has k eigenvalues 
with negative real part and n — k eigenvalues with positive real part. Then 
there exists a k-dimensional differentiable manifold S tangent to the stable 
subspace E* of the linear system (2) at 0 such that for allt > 0,6,(S) Cc S 
and for all xo € S. 


Jim. $, (xo) = 0; 


and there exists ann —k dimensional differentiable manifold U tangent to 
the unstable subspace E“ of (2) at O such that for allt < 0,¢,(U) C U and 
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for all xg € U, 
_jim | $;(X0) = 0. 


Before proving this theorem, we remark that if f € C'(E) and f(0) = 0, 
then the system (1) can be written as 


x = Ax + F(x) (3) 


where A = Df(0), F(x) = f(x)— Ax, F € C!(E), F(0) = 0 and DF(0) = 0. 
This in turn implies that for all ¢ > 0 there is a 6 > 0 such that |x| < 6 
and |y| < 6 imply that 


IF(x) — F(y)| < ex — yl. (4) 


Cf. problem 6. 
Furthermore, as in Section 1.8 of Chapter 1, there is an n x n invertible 
matrix C’ such that 


P 0 
— (1-1 “ 
where the eigenvalues A,,...,A,% of the k x k matrix P have negative real 


part and the eigenvalues Ax41,...,An of the (n — k) x (n — k) matrix Q 
have postive real part. We can choose a > 0 sufficiently small that for 
Pe lik, 


Re(A;) < -a <0. (5) 
Letting y = C—'x, the system (3) then has the form 
y = By + G(y) (6) 


where G(y) = C~!F(Cy) € C1(E) where E = C~1(E) and G satisfies the 
Lipschitz-type condition (4) above. 

It will be shown in the proof that there are n — k differentiable functions 
w;(y1,---. yk) such that the equations 


Y5 = 0; (y1,--- Yk): j=k+l,...,n 


define a k-dimensional differentiable manifold S in y-space. The differ- 
entiable manifold S in x-space is then obtained from S under the linear 
transformation of coordinates x = Cy. 


Proof. Consider the system (6). Let 


vw=[% 4 and V(t) =|, me 


Then U = BU,V = BV and 
e®t = U(t) + V(t). 
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It is not difficult to see that with a > 0 chosen as in (5), we can choose 
K > 0 sufficiently large and o > 0 sufficiently small that 


|U(t)|| < Ke (o+)* for all t > 0 


and 
|V(t)|| < Ke for all t < 0. 


Next consider the integral equation 


u(t, a) = uioat [ U(t—s)G(u(s, a))ds— V(t—s)G(u(s,a))ds. (7) 
0 t 


If u(t,a) is a continuous solution of this integral equation, then it is a 
solution of the differential equation (6). We now solve this integral equation 
by the method of successive approximations. Let 


u)(t,a) = 0 


and 


uJ+))(t,a) = U(t)at [ U(t — s)G(u")(s, a))ds 
i) 


oo 
. | V(t — s)G(u(s, a))ds. (8) 
t 
Assume that the induction hypothesis 
. ps K|ale~** 
ju) (t,a) — u9-)(t, a)| < =e (9) 


holds for j = 1,2,...,mandt > 0. It clearly holds for 7 = 1 provided t > 0. 
Then using the Lipschitz-type condition (4) satisfied by the function G and 
the above estimates on ||U(t)|| and ||V(¢)||, it follows from the induction 
hypothesis that for t > 0 


t 
fal™+)(t, a) —ul™ (t, a) < i U(t — s)lelu™(s, a) —w™-(s, a)|as 
: oo 
+ i} V(t — s)lleju™(s, a)—u"-(s, a)|ds 
t 
a / en (otay(t—2) Klale"** 
= 0 gm—1 


oo —as 
+e | Ke?(t-8) ace ds 
eK?lale~** eK?\ale~* 

ee, ane a 
3 (; 7 Klale“** _ K|ale~** 


+ gm—1 Qm 


4/4 ep) 
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provided eK /a < 1/4; i.e., provided we choose € < 3%. In order that the 
condition (4) hold for the function G, it suffices to choose Kla| < 6/2; 
i.e., we choose |a| < a - It then follows by induction that (9) holds for all 
7=1,2,3,... andt >0. Thus, forn >m> WN andt>0, 


co 
Ju”) (t,a) —ul™(t,a)] < So fuPt)(t, a) — u(t, a)| 
j=N 


This last quantity approaches zero as N — oo and therefore {u\J)(t, a)} is 
a Cauchy sequence of continuous functions. According to the theorem in 
Section 2.2, 

lim u(t, a) = u(t, a) 

jJ— CO 


uniformly for all t > 0 and |aj < 6/2K. Taking the limit of both sides of 
(8), it follows from the uniform convergence that the continuous function 
u(t, a) satisfies the integral equation (7) and hence the differential equation 
(6). It follows by induction and the fact that G € C!(E) that u)(t, a) is 
a differentiable function of a for t > 0 and |a| < 6/2K. Thus, it follows 
from the uniform convergence that u(t, a) is a differentiable function of a 
for t > 0 and |a| < 6/2K. The estimate (10) implies that 


|u(t, a)| < 2K|ale~** (11) 


for t > 0 and [a| < 6/2K. 

It is clear from the integral equation (7) that the last n — k components 
of the vector a do not enter the computation and hence they may be taken 
as zero. Thus, the components u;(t,a) of the solution u(t, a) satisfy the 
initial conditions 

u;(0,a) =a; for j =1,...,k 
and 
oo 

u;(0,a) = — (/ V(~8)G(u(s,a1,.-.,44,0))ds for j =k+1,...,n 

0 j 
For j = k+1,...,n we define the functions 

;(a1,..-,@x) = uj(0,a1,...,a%,0,...,0). (12) 
Then the initial values y; = u;(0,a),...,a,%,0,...,0) satisfy 


yj = W;(Yi,---s Ye) forj =k+1,...,n 


according to the definition pat): These equations then define a differentiable 
manifold S for /y? +---+y? < 6/2K. Furthermore, if y(t) is a solution 
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of the differential equation (6) with y(0) € S, i.e., with y(0) = u(0,a), 
then 


y(t) = u(t,a). 


It follows from the estimate (11) that if y(t) is a solution of (6) with 
y(0) € S, then y(t) — 0 as t > oo. It can also be shown that if y(t) is a 
solution of (6) with y(0) ¢ S then y(t) 4 0 as t — oo; cf. Coddington and 
Levinson [C/L], p. 332. It therefore follows from Theorem 2 in Section 2.5 
that if y(0) € S, then y(t) € S for all t > 0. And it can be shown as in 
[C/L], p. 333 that 


OW; ny _ 
By) =° 


fori =1,...,k andj = k+1,...,n; ie, the differentiable manifold S is 
tangent to the stable subspace E* = {y € R” | y; = --- yx = 0} of the 
linear system y = By at 0. 

The existence of the unstable manifold U of (6) is established in exactly 
the same way by considering the system (6) with t > —t, i.e., 


y = —By - G(y). 


The stable manifold for this system will then be the unstable manifold 
U for (6). Note that it is also necessary to replace the vector y by the 
vector (Yk41,--+)Yns ¥i>---) Yk) in order to determine the n—k dimensional 
manifold U by the above process. This completes the proof of the Stable 
Manifold Theorem. 


Remark 1. The first rigorous results concerning invariant manifolds were 
due to Hadamard [10] in 1901, Liapunov [17] in 1907 and Perron [26] in 
1928. They proved the existence of stable and unstable manifolds of sys- 
tems of differential equations and of maps. (Cf. Theorem 3 in Section 4.8 
of Chapter 4.) The proof presented in this section is due to Liapunov and 
Perron. Several recent results generalizing the results of the Stable Mani- 
fold Theorem have been given by Hale, Hirsch, Pugh, Shub and Smale to 
mention a few. Cf. [11, 14, 30]. We note that if the function f € C’(E) 
and r > 1, then the stable and unstable differentiable manifolds S and U 
of (1) are of class C”. And if f is analytic in E& then S and U are analytic 
manifolds. 


We illustrate the construction of the successive approximations wu) (t, a) 
in the proof with an example. 


Example 2. Consider the nonlinear system 


i, = —2, -— 23 to = 294+ 2%. 
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We shall find the first three successive approximations u")(¢, a), u(?)(t, a) 
and u!3)(t, a) defined by (8) and use u\)(t, a) to approximate the function 
a. describing the stable manifold 


S: 22 = ho(21). 
For this problem, we have 


A= B= Fe , F(x) = G(x) = 7 : 


vw =| de vie) = |, i and a= (9). 


We approximate the solution of the integral equation 


_ fea], [ [-e ug (s) ian ee 
ae eat era 


by the successive approximations 
u)(t,a) =0 
—t 
u)(t,a) = i a 


—t co 0 e~*a 
u (t, a) | 0 / Per ds . — , 


-t 1 ft [e-(t-8) .-48,,4 oo 0 
(tp ay= |& % -5/ e e~ “Fat -[ 
u ( , a) 0 9 P | 0 ds : e'8e~ 28 q? ds 


_ re + w(e7* - = 


It can be shown that u“)(¢, a)—u)(t, a) = 0(a°) and therefore the function 
a.(a,) = ue(0,a),0) is approximated by 


1 
(a1) = — 34} + 0(a}) 
as a, — 0. Hence, the stable manifold S is approximated by 
2 
S: 29 = -3 + 0(z?) 


as ©, — 0. The matrix C = J, the identity, for this example and hence the x 
and y spaces are the same. The unstable manifold U can be approximated 
by applying exactly the same procedure to the above system with t — —t 
and zx; and 22 interchanged. The stable manifold for the resulting system 
will then be the unstable manifold for the original system. We find 


z3 5 
U: 24, = erg + 0(2z3) 
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as I — 0. The student should verify this calculation. The approximations 
for the stable and unstable manifolds S and U in a neighborhood of the 
origin and the stable and unstable subspaces E* and E™ for x = Ax are 
shown in Figure 2. 


Figure 2 


The stable and unstable manifolds S and U are only defined in a small 
neighborhood of the origin in the proof of the stable manifold theorem. S 
and U are therefore referred to as the local stable and unstable manifolds 
of (1) at the origin or simply as the local stable and unstable manifolds of 
the origin. We define the global stable and unstable manifolds of (1) at 0 
by letting points in S flow backward in time and those in U flow forward 
in time. 


Definition 3. Let @, be the flow of the nonlinear system (1). The global 
stable and unstable manifolds of (1) at 0 are defined by 


w*(0) = 4(5) 


t<0 


and 


w*(0) = LU) 4.(U) 


t>0 


respectively; W*(0) and W%(0) are also referred to as the global stable 
and unstable manifolds of the origin respectively. It can be shown that the 
global stable and unstable manifolds W*(0) and W%(0) are unique and 
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Xo 


Figure 3 


that they are invariant with respect to the flow @,; furthermore, for all 
x € W*(0), jim o,(x) = 0 and for all x € W“(0), lim @,(x) = 0. 
—0o — =O 
As in the proof of the Stable Manifold Theorem, it can be shown that in 
a small neighborhood, N, of a hyperbolic critical point at the origin, the 


local stable and unstable manifolds, S and U, of (1) at the origin are given 
by 


S={xeéeN | $,(x) — 0 as t — o0 and @,(x) € N for t > 0} 
and 
U={xe N | $,(x) — 0 as t + —00 and @¢,(x) € N for t < 0} 


respectively. Cf. [G/H], p. 13. 

Figure 3 shows some numerically computed solution curves for the system 
in Example 2. The global stable and unstable manifolds for this example are 
shown in Figure 4. Note that W*(0) and W“(0) intersect in a “homoclinic 
loop” at the origin. W*(0) and W™“(0) are more properly called “branched 
manifolds” in this example. 
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w(0) w(0) 


Figure 4 


It follows from equation (11) in the proof of the stable manifold theorem 
that if x(t) is a solution of the differential equation (6) with x(0) € S, i.e., 
if x(t) = Cy(t) with y(0) = u(0,a) € S, then for any ¢ > 0 there exists a 
6 > 0 such that if |x(0)| < 6 then 


|x(t)| < ee“ 


for all ¢ > 0. Just as in the proof of the stable manifold theorem, a is 
any positive number that satisfies Re(A;) < —a for 7 = 1,...,k where 4,, 
j =1,...,k are the eigenvalues of Df(0) with negative real part. This result 
shows that solutions starting in S, sufficiently near the origin, approach the 
origin exponentially fast as t — oo. 


Corollary. Under the hypotheses of the Stable Manifold Theorem, if S 
and U are the stable and unstable manifolds of (1) at the origin and if 
Re(A;) < -a <0 < 8B < Re(Am) for j = 1,...,k andm=k+1.,...,n, 
then given € > 0 there exists a 6 > 0 such that if xo € Ns(0)NS then 


|p, (x0)| < ee" ™* 


for allt > 0 and if xo € Ns(0)NU then 


|o.(x0)| < ee” 


for allt <0. 


We add one final result to this section which establishes the existence of 
an invariant center manifold W°(0) tangent to E* at 0; cf., e.g., [G/H], 
p. 127 or [Ru], p. 32. The next theorem follows from the local center mani- 
fold theorem, Theorem 2 in Section 2.12, and the stable manifold theorem 
in this section. 
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Theorem (The Center Manifold Theorem). Let f € C’(E) where E is an 
open subset of R” containing the origin and r > 1. Suppose that f(0) = 0 
and that Df(0) has k eigenvalues with negative real part, j eigenvalues 
with positive real part, andm =n—k-—j eigenvalues with zero real part. 
Then there exists an m-dimensional center manifold W°(0) of class C™ 
tangent to the center subspace E“ of (2) at 0, there exists a k-dimensional 
stable manifold W*(0) of class C” tangent to the stable subspace E* of (2) 
at O and there exists a j-dimensional unstable manifold W“(0) of class 
C” tangent to the unstable subspace E“ of (2) at 0; furthermore, W‘(0), 
W*(0) and W*(0) are invariant under the flow ¢, of (1). 


Example 3. Consider the system 


LD) = x 
2 = —TZ2. 


The stable subspace E* of the linearized system at the origin is the x-axis 
and the center subspace E* is the x,-axis. This system is easily solved and 
the phase portrait is shown in Figure 5. 


Figure 5. The phase portrait for the system in Example 3. 


Any solution curve of the system in Example 3 to the left of the ori- 
gin patched together with the positive z-axis at the origin gives a one- 
dimensional center manifold of class C™® which is tangent to E* at the ori- 
gin. This shows that, in general, the center manifold W°(0) is not unique; 
however, in Example 3 there is only one analytic center manifold, namely, 
the z-axis. 

In Section 2.12, we give a method for approximating the shape of the 
analytic center manifold near a nonhyperbolic critical point and show that 
approximating the shape of the center manifold W°(0) near the nonhyper- 
bolic critical point at the origin is essential in determining the flow on the 
center manifold; cf. Example 1 in Section 2.12. In Section 2.13, we present 
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a method for simplifying the system of differential equations determining 
the flow on the center manifold. 


PROBLEM SET 7 
1. Write the system 


Z)} = 27+ 672+ 222 


Lq = 42, + 322 — x? 


in the form 
y = By + Gly) 


4 0 
Bala a) 


A; <0, Az > O and G(y) is quadratic in y, and yo. 


where 


2. Find the first three successive approximations u)(t, a), u(2)(t, a) and 
ul3)(¢, a) for 


t) =—-Z 

to =29+2° 
and use u(t, a) to approximate S near the origin. Also approximate 
the unstable manifold U near the origin for this system. Note that 


u(?)(t, a) = u(3)(t, a) and therefore u@+?)(t, a) = u"J)(t, a) for j > 2. 
Thus u%)(t,a) — u(t,a) = u?(t,a) which gives the exact function 


defining S. 
3. Solve the system in Problem 2 and show that S and U are given by 
2 
oa o 
S: Z2 3 
and 
U: Zr} = 0. 


Sketch S, U, E* and E”. 


4. Find the first four successive approximations u“)(t,a), u(?)(t,a), 
u3(t,a), and u(4)(t, a) for the system 
It) = —2 
Iq = —-I9+ x? 
23 =23+ x3. 


Show that ul9)(¢,a) = u(4)(t,a) = --- and hence u(t, a) = u(t, a). 
Find S and U for this problem. 
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5. Solve the above system and show that 


1 1 1 
S: 23 = 329 - atize - 3071 
and 
U: x} = 22 = 0. 


Note that these formulas actually determine the global stable and 
unstable manifolds W*(0) and W“(0) respectively. 


. Let E be an open subset of R” containing the origin. Use the fact that 


if F € C'(E) then for all x,y € Ns(0) C E there exists a € € Ng(0) 
such that 

[F(x) — F(y)| < || DF(4)ll x - y| 
(cf. Theorem 5.19 and the proof of Theorem 9.19 in [R]) to prove 
that if F € C!(E) and F(0) = DF(0) = 0 then given any ¢ > 0 there 
exists a 6 > 0 such that for all x, y € Ns(0) we have 


|F(x) — F(y)| < elx — yl. 


. Show that the unit circle 


C=S'={xeR?|2?+y? =1} 


is an orientable, one-dimensional, differentiable manifold; i.e., find an 
orientation-preserving atlas (U;,h;),...,(U4, hg) for C. 


. Show that the unit two-dimensional sphere 


S? = {xe R3|2?+y?4+2?=1} 


is an orientable, two-dimensional, differentiable manifold. Do this us- 
ing the following orientation-preserving atlas: 


U, = {x € S? | z > 0}, U2 = {x € S? | z<0}, U3 = {x € S? | y>0}, 
Us = {x € S? | y < 0},Us = {x € S? | r>0}, Ug = {x € S? | z<0}, 


hi(z,y,z) = (z,y), hy '(z,y) = (z,y, V1 — 2? — y?) 
ho(z, y, 2) = (y,z), hy" (y, 2) = (z,y, -V/1 — 2? - y?) 
h3(z, y, z) = (z,z), hg 1(z,2) = (z, V1 — £2 — 2?,z) 
h4(z, y, z) = (z,z), hy (z, z) = (z, -V1 — 2? — 22, z) 
hs(z, y,z) = (y,z), hg *(y,z) = (V1 — y? — z?,y,z) 
he(z, y, 2) = (z,y), hg *(z,y) = (—V1 — y? — z*,y, 2). 
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To show this, compute h; o h5"(x), Dh; o h>*(x), and show that 
det Dh; o h5*(x) > 0 for all x € hj(U; NU;) where U; NU; # 9. 
Note that you only need to do this for 7 > 1, U; NUg = U3NU, = 
U; Ug, = @, and that the atlas has been chosen to preserve outward 
normals on S*. Hint: Start by showing that 


h ohj'(z,z) = (zr, 1-2? — z?), 


0 1 
Dhy ohs*(z,2) = | a = 
a ar 
and that 
det Dh, ohy!(z, 2) = === > 0 
eS agteag 


for all (z,x) € h3(U; NU3) = {(z,z) € R? | 2? + 2? < 1,z > O}. 


2.8 The Hartman—Grobman Theorem 


The Hartman-—Grobman Theorem is another very important result in the 
local qualitative theory of ordinary differential equations. The theorem 
shows that near a hyperbolic equilibrium point xo, the nonlinear system 


x = f(x) (1) 
has the same qualitative structure as the linear system 
x = Ax (2) 


with A = Df(xo). Throughout this section we shall assume that the equi- 
librium point xo has been translated to the origin. 


Definition 1. Two autonomous systems of differential equations such as 
(1) and (2) are said to be topologically equivalent in a neighborhood of the 
origin or to have the same qualitative structure near the origin if there is 
a homeomorphism H mapping an open set U containing the origin onto 
an open set V containing the origin which maps trajectories of (1) in U 
onto trajectories of (2) in V and preserves their orientation by time in the 
sense that if a trajectory is directed from x to x2 in U, then its image is 
directed from H(x,) to H(x2) in V. If the homeomorphism H preserves 
the parameterization by time, then the systems (1) and (2) are said to be 
topologically conjugate in a neighborhood of the origin. 

Before stating the Hartman-—Grobman Theorem, we consider a simple 
example of two topologically conjugate linear systems. 
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Example 1. Consider the linear systems x = Ax and y = By with 


-1 -3 2 O 
A=["3 | and B= | He 


Let H(x) = Rx where the matrix 


rfl] malt I) 


Then B = RAR™ and letting y = H(x) = Rx or x = R7'y gives us 
y = RAR-'y = By. 


Thus, if x(t) = e4*xo is the solution of the first system through x9, then 
y(t) = H(x(t)) = Rx(t) = Re4txo = e?* Rxp is the solution of the second 
system through Rx; i.e., H maps trajectories of the first system onto 
trajectories of the second system and it preserves the parameterization 
since 


Het = e? *H. 


The mapping H(x) = Rx is simply a rotation through 45° and it is clearly 
a homeomorphism. The phase portraits of these two systems are shown in 
Figure 1. 


xo ¥2 


Figure 1 


Theorem (The Hartman-Grobman Theorem). Let E be an open subset 
of R” containing the origin, let f € C'(E), and let d, be the flow of the 
nonlinear system (1). Suppose that f{(0) = 0 and that the matriz A = Df(0) 
has no eigenvalue with zero real part. Then there exists a homeomorphism 
H of an open set U containing the origin onto an open set V containing 
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the origin such that for each xo € U, there is an open interval Ip C R 
containing zero such that for allxg EU andt € Ip 


H 0 ¢,(xo) = e4*H (x0); 


t.e., H maps trajectories of (1) near the origin onto trajectories of (2) near 
the origin and preserves the parameterization by time. 


Outline of the Proof. Consider the nonlinear system (1) with f € C'(E), 
f(0) = 0 and A = Df(0). 
1. Suppose that the matrix A is written in the form 


P 0 
A=10 al 
where the eigenvalues of P have negative real part and the eigenvalues of 


Q have positive real part. 
2. Let @, be the flow of the nonlinear system (1) and write the solution 


y(t, Yo, Zo) 
x(t, X0) = (xo) = Anton 


where 
Xo = is = R”, 
Zo 


Yo € E*, the stable subspace of A and Zp € E”, the unstable subspace of 
A. 
3. Define the functions 


Y(yo, 20) = y(1, yo, Zo) — eyo 


and ; 

Z(yo,Z0) = 2(1, Yo, 20) — e* Zo. 
Then Y(0) = _Z(0) = DY(0) = DZ(0) = 0. And since f € C'(E), 
Y(yo, Zo) and Z(Yo, Zo) are continuously differentiable. Thus, 


DY (y0,z0)ll < @ 


and 5 
|DZ(yo, 20) || < a 


on the compact set |yo|? + |zo|? < s2. The constant a can be taken as 
small as we like by choosing so sufficiently small. We let Y(yYo,Z0) and 
Z(yo, Zo) be smooth functions which are equal to ¥(Yo, Zo) and Z(Yo, Zo) 
for |yo|? + |Zo|? < (so/2)? and zero for |yo|? +|zo|? > s2. Then by the mean 
value theorem 


[¥ (yo, 20)| S$ av/lyol? + |zo|? < a(lyo] + |Zol) 
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and 
IZ(yo, Z0)| < aV/lyol? + |zo|? < a(lyo| + |Zol) 


for all (yo,Z) € R”. We next let B = e? and C = e®. Then assuming 
that we have carried out the normalization in Problem 7 in Section 1.8 of 
Chapter 1, cf. Hartman [H], p. 233, we have 


b=||Bl|<1 and c=|\C7'| <1. 


4. For 
x= H € R” 
Z 
define the transformations 
B 
Liy.2) = [@ | 


By + Y(y,z)] | 
T(y,z) = Ce + Z(y,z) |’ 


ie., L(x) = e4x and locally T(x) = (x). 


Lemma. There exists a homeomorphism H of an open set U containing 
the origin onto an open set V containing the origin such that 


HoT=Lod. 


We establish this lemma using the method of successive approximations. 
For x € R”, let 
®(y, z) 
H(x) = . 
©) = Lay) 
Then H oT = Lo H is equivalent to the pair of equations 


BO(y,z) = (By +Y(y,z),Cz+ Zy,z)) (3) 
CW(y,z) = W(By + Y(y,z),Cz+ Z(y,z)). 


First of all, define the successive approximations for the second equation 
by 
Voly, Zz) =z (4) 
Wraily,z) = CY, (By + ¥(y,z),Cz + Z(y,z)). 
It then follows by an easy induction argument that for k = 0,1,2,..., the 
V,.(y,z) are continuous and satisfy Y,(y,z) = z for |y| + |z| > 2s9. We 
next prove by induction that for j = 1,2,... 


[Y5(y,z) — Y5-1(y,z)| < Mr (ly| + [2|)° (5) 
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where r = c[2max(a, b,c)]° with 6 € (0,1) chosen sufficiently small so that 
r < 1 (which is possible since c < 1) and M = ac(2so)!~°/r. First of all for 
j=l 
|Vi(y,z) — Yoly,z)| = C7 Wo(By + Y(y,z),Cz + Z(y,z)) — 2 
= |C~'(Cz + Z(y,z)) — 2 
= |C7'Z(y,z)| < IC IIIZ(y, 2) 
< ca(ly| + |2|) < Mr(ly| + |2l)° 


since Z(y,z) = 0 for |y|+|z| > 2s9. And then assuming that the induction 
hypothesis holds for j = 1,...,k we have 


|Wisily,z) — Vey, z)| = |C7'U.(By + ¥(y,z),Cz + Z(y,z)) 
— C7'Y,_1 (By + ¥(y,z),Cz + Z(y,z))| 
S Oum Ge") — Ge-1(")| 
< cMr*||By + Y(y,z)| + |Cz + Z(y,z)|]° 
< cMr*[bly| + 2a(ly| + |z|) + clzi]° 
< cMr*(2 max(a, b, c)]*(ly| + |z|)° 
= Mr***(\y| + |z])° 


Thus, just as in the proof of the fundamental theorem in Section 2.2 and the 
stable manifold theorem in Section 2.7, Y,(y,z) is a Cauchy sequence of 
continuous functions which converges uniformly as k — oo to a continuous 
function U(y,z). Also, V(y,z) =z for |y| + |z| > 2s. Taking limits in (4) 
shows that W(y,z) is a solution of the second equation in (3). 

The first equation in (3) can be written as 


B-'@(y,z) = &(B-'y + Yi(y,z),C7'z + Zi(y,z)) (6) 


where the functions Y, and Z) are defined by the inverse of T (which 
exists if the constant a is sufficiently small, i.e., if so is sufficiently small) 
as follows: 

Boy + Yily, 4 
Colz + Zily, Z) 
Then equation (6) can be solved for ®(y,z) by the method of successive 


approximations exactly as above with ®o(y, z) = y since b = ||B|| < 1. We 
therefore obtain the continuous map 


T~'(y,z) = | 


P(y,z) 
W(y,z)| 


And it follows as on pp. 248-249 in Hartman [H] that H is a homeomor- 
phism of R” onto R”. 


H(y.2) = | 
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5. We now let Hp be the homeomorphism defined above and let L* and 
T' be the one-parameter families of transformations defined by 


L‘(xo) = e“*xo and T*(xo) = ,(xo). 
Define 
He» | L~* HoT? ds. 
0 


It then follows using the above lemma that there exists a neighborhood of 
the origin for which 


1 
LH = | L*-* HoT*®~‘ ds T* 
i) 
1-t 
a L-*HoT® dsT* 
-t 


0 
= / L~* HoT? ds + 
-t 0 


1-t 


L~* HoT? as 6 ba 
1 
= | L~*HoT* dsT* = HT* 
0 
since by the above lemma Ho = L~!HoT which implies that 


0 0 
/ L-*HoT* ds = / L-*" HoT** ds 
—t t 


1 
= L~* HoT® ds. 


1—t 


Thus, H oT = L‘H or equivalently 


H 0 $, (Xo) = e“* H (xo) 


and it can be shown as on pp. 250-251 of Hartman [H] that H is a homeoc- 
morphism on R”. This completes the outline of the proof of the Hartman- 
Grobman Theorem. 


We now illustrate how the successive approximations, defined by (4), can 
be used to obtain the homeomorphism H(x) = [®(y,z), ¥(y,z)]7. In the 
following example, the successive approximations actually converge to a 
global homeomorphism which maps solutions of (1) onto solutions of (2) 
for all xo € R? and for all t € R. Of course, this does not happen in general; 
cf. Problem 4. 


Example 2. Consider the system 


y=-y 
z=z+y’. 
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The solution with y(0) = yo and 2(0) = 2p is given by 


y(t) = yoe 


z(t) =z t ye t  .~2t 
= ze + 3 (e en), 


Thus in the context of the above proof B = e~!, C =e, Y(yo, 20) = 0 and 


2 . k _ e? _— 1 
Z(yo, 20) =kyg with k= nega 
Therefore, solving 
CVU(y,z) = U(By + Y(y, z),Cz + Z(y,z)) 
is equivalent to solving 
eW(y,z) = U(e71y, ez + ky’). (7) 
The successive approximations defined by (4) are given by 
Voly, z) =< 
Wi(y,z) =zt+ke!y? 
Wo(y,z) =z+ke "(1+ e74)y? 
W3(y,z) =zt+ke "(1 +e73 + e7®)y? 


Umn(y,z) = z+ ke [1 +e 3 +--+. + (e73)™Yy?. 
The serious student should verify these calculations. Thus, as m — oo 


y? 
Vly, z) ~ V(y,z) = z+ os 


uniformly for (y,z) € R?. The function U(y, z) satisfies equation (7). Sim- 
ilarly, the function ®(y, z) is found by solving 


Bo G(y,z) = &(B-y + Yi(y,z),C71z + Zi (y, z)) 
where Y,(y, z) = 0 and Z,(y,z) = —eky?. This leads to 
O(y,z) =y 
for all (y,z) € R?. 
Thus, the homeomorphism Hp is given by 


Holy, z) = . a Al 
and 


- y 
Hotne)= |," a]- 
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For L(y, z) = e4(y,z)7 = (e71y, ez)? and T(y, z) = dy (y, 2) = (e7'y,ez + 
ky”)? , it follows that Hp oT = Lo Ho as in the above lemma. The home- 


omorphism H is then given by 


1 
H= i L-*HoT* ds 
0 


where ; 
o- 
L*(y,z) = ¥ 4 
and 
ey 
T'(y,z) = 
(2) e'z+ uw (et a 
Thus, 
y 
H(y,z) = | ] 
z+% 
and 
L'H ov" =| = Hor" 
(y, z) a eztet = 450 (y, z). 


The student should verify these computations. The phase portraits for 
the nonlinear system (1) and the linear system (2) of this example are 
shown in Figure 2. The stable subspace E* = {(y,z) € R? | z = 0} gets 
mapped onto the stable manifold W*(0) = {(y,z) € R? | z = —y?/3} by 
the homeomorphism H~!; and the unstable subspace E™ = {(y,z) € R? | 
y = 0} gets mapped onto the unstable manifold W“(0) = {(y, z) € R? | 
y = 0} by H™!. Trajectories, such as z = 1/y, of the linear system get 
mapped onto trajectories, such as z = . — v, by H-! and H preserves the 
parameterization by time. 


A 
- 


Figure 2 
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The above proof of the Hartman-Grobman Theorem is due to P. Hart- 
man; cf. [H], pp. 244-251. It was proved independently by P. Hartman [12] 
and the Russian mathematician D.M. Grobman [9] in 1959. This theorem 
with f, H and H—! analytic was proved by H. Poincaré in 1879, cf. [28], 
under the assumptions that the elementary divisors of A (cf. [Cu], p. 219) 
are simple and that the eigenvalues \;,...,A, of A lie in a half plane in C 
and satisfy 


Aj XZ mA, +-+++MnAn (8) 


for all sets of non-negative integers (m ,...,m,) satisfying m,+---+m, > 
1. An analogous result for smooth f, H and H-! was established by 
S. Sternberg [33] in 1957. And for f of class C?, Hartman [13] in 1960 
proved that there exists a continuously differentiable map H with a contin- 
uously differentiable inverse H—! (i.e., a C!-diffeomorphism) satisfying the 
conclusions of the above theorem even without the Diophantine conditions 
(8) on A;: 


Theorem (Hartman). Let E be an open subset of R” containing the point 
Xo, let f € C?(E), and let d, be the flow of the nonlinear system (1). 
Suppose that f(x9) = O and that all of the eigenvalues \1,...,An of the 
matriz A = Df(xo) have negative (or positive) real part. Then there exists 
a C'-diffeomorphism H of a neighborhood U of xo onto an open set V 
containing the origin such that for each x € U there ts an open interval 
I(x) C R containing zero such that for allx € U and t € I(x) 


H 0 d,(x) = e4*H(x). (9) 


The student should compare this theorem and the Hartman-—Grobman 
Theorem in the context of Example 5 in Section 2.10 of this chapter. Also, it 
should be noted that assuming the existence of higher derivatives of f does 
not imply the existence of higher derivatives of H without Diophantine- 
type conditions on 4;. In fact, Sternberg showed that in general even if f 
is analytic, there does not exist a mapping H with H and H™! of class C? 
satisfying (9); cf. Problem 5. 


PROBLEM SET 8 


1. Solve the system 


y= 1 
Jo = —y2 +2" 
z=2z 


and show that the successive approximations ®, — ® and U, — WU 
as k — oo for all x = (y;, y2,z) € R*. Define Hp = (®, V)7 and use 
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this homeomorphism to find 
H= [ L~* HoT* ds. 
Use the homeomorphism H to find the stable and unstable manifolds 


W*(0) = H-(E*) and W*(0) = H7}(E*) 


for this system. 
Hint: You should find 


H(y1, ya; Z) = (y1, Y2 as z*/3, z)7 
W*(0) = {x € R?|z=0} 


and 
W"(0) = {x € R? | y1 = 0,42 = z? /3}. 


. Same thing for 


y=-y 
Z) = 2) 
z2 = zoty? + yz. 


. Same thing for 


yn=-yn 
jo=—yoty? 
z=z+y? 


Hint: Here the successive approximations for ® as given by (3) con- 
verge globally. 


. Show that the successive approximations for ® as given by (3) or (6) 


do not converge globally for the system 


y= 
Yo = —y2 + yfz 
z=2z. 


. Show that the successive approximations (4) for H(z) = Y(z) do not 


converge globally for the analytic system 


2) = 22) 


do = 429 + 27. 
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Furthermore, show that if H(z) is any C?-function which satisfies 
(9), then the Jacobian J(z) = det DH(z) vanishes at z = 0. This in 
turn implies that the inverse H—', if it exists, is not differentiable at 
z = 0. (Why?) 

Hint: First solve this system to obtain z(t) = ,(Zo). Then show 
that if H = (H, HH)? satisfies the above equation, (9), for t = 1 we 
get 

CH(z) = H(Cz + egetz? 

where C = e4, A = diag(2, 4), e2 = (0,1)? and Ine = 1. Differentiate 
the second component of this equation partially with respect to z, to 


get aH 
2 
——(0,0) = 0. 
Dz, (0, 0) 
A second partial differentiation with respect to z, then shows that 
OH2 
Pay, 0) = 0; 


i.e. the Jacobian J(0) = det DH(0) = 0. 


2.9 Stability and Liapunov Functions 


In this section we discuss the stability of the equilibrium points of the 
nonlinear system 

x = f(x). (1) 
The stability of any hyperbolic equilibrium point x9 of (1) is determined 
by the signs of the real parts of the eigenvalues A; of the matrix Df(x9). 
A hyperbolic equilibrium point x9 is asymptotically stable iff Re(A;) < 0 
for 7 = 1,...,n; i.e., iff xo is a sink. And a hyperbolic equilibrium point xq 
is unstable iff it is either a source or a saddle. The stability of nonhyper- 
bolic equilibrium points is typically more difficult to determine. A method, 
due to Liapunov, that is very useful for deciding the stability of nonhyper- 
bolic equilibrium points is presented in this section. Additional methods 
are presented in Sections 2.11-2.13. 


Definition 1. Let ¢, denote the flow of the differential equation (1) de- 
fined for all t € R. An equilibrium point x9 of (1) is stable if for all e > 0 
there exists a 6 > 0 such that for all x € Ns(xo) and t > 0 we have 


$,(x) € Ne(xo). 


The equilibrium point x9 is unstable if it is not stable. And x9 is asymp- 
totically stable if it is stable and if there exists a 6 > 0 such that for all 
x € Ns(xo) we have 

in Pr(X) = Xo. 
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Note that the above limit being satisfied for all x in some neighborhood of 
Xo does not imply that xo is stable; cf. Problem 7 at the end of Section 3.7. 

It can be seen from the phase portraits in Section 1.5 of Chapter 1 that 
a stable node or focus of a linear system in R? is an asymptotically stable 
equilibrium point; an unstable node or focus or a saddle of a linear system 
in R? is an unstable equilibrium point; and a center of a linear system in 
R? is a stable equilibrium point which is not asymptotically stable. 

It follows from the Stable Manifold Theorem and the Hartman-Grobman 
Theorem that any sink of (1) is asymptotically stable and any source or 
saddle of (1) is unstable. Hence, any hyperbolic equilibrium point of (1) 
is either asymptotically stable or unstable. The corollary in Section 2.7 
provides even more information concerning the local behavior of solutions 
near a sink: 


Theorem 1. If xo is a sink of the nonlinear system (1) and Re(A;) < 
—a < 0 for all of the eigenvalues A; of the matrix Df(xo), then given 
€ > 0 there exists a 6 > 0 such that for all x € Ng(xo), the flow $,(x) of 
(1) satisfies 


|p,(x) — xo| < ee ™* 


for allt > 0. 


Since hyperbolic equilibrium points are either asymptotically stable or 
unstable, the only time that an equilibrium point xo of (1) can be stable 
but not asymptotically stable is when Df(xq) has a zero eigenvalue or a 
pair of complex-conjugate, pure-imaginary eigenvalues \ = +ib. It follows 
from the next theorem, proved in [{H/S], that all other eigenvalues A, of 
Df(xo) must satisfy Re(A;) < 0 if xo is stable. 


Theorem 2. If xo is a stable equilibrium potnt of (1), no eigenvalue of 
Df (xo) has positive real part. 


We see that stable equilibrium points which are not asymptotically stable 
can only occur at nonhyperbolic equilibrium points. But the question as to 
whether a nonhyperbolic equilibrium point is stable, asymptotically stable 
or unstable is a delicate question. 

The following method, due to Liapunov (in his 1892 doctoral thesis), is 
very useful in answering this question. 


Definition 2. If f € C'(E), V € C'(E) and 4, is the flow of the differen- 
tial equation (1), then for x € E the derivative of the function V(x) along 
the solution $,(x) 


V(x) = FV(be())ha0 = DV(x)E(W) 
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The last equality follows from the chain rule. If V(x) is negative in E 
then V(x) decreases along the solution @,(xo) through x9 € E at t = 0. 
Furthermore, in R?, if V(x) < < 0 with equality only at x = 0, then for small 
positive C’, the family of curves V(x) = C constitutes a family of closed 
curves enclosing the origin and the trajectories of (1) cross these curves 
from their exterior to their interior with increasing ¢; i.e., the origin of (1) 
is asymptotically stable. A function V: R" — R satisfying the hypotheses 
of the next theorem is called a Liapunov function. 


Theorem 3. Let E be an open subset of R” containing xo. Suppose that 
f € C'(E) and that f(xo) = 0. Suppose further that there exists a real 
valued function V € C'(E) satisfying V(xo) = 0 and V(x) > 0 if x # xo. 
Then (a) if V(x) < 0 for all x € E, xo is stable; (b) i V(x) < 0 for 
all x € E ~ {xo}, Xo is asymptotically stable; (c) if V(x) > 0 for all 
x € E ~ {xo}, Xo ts unstable. 


Proof. Without loss of generality, we shall assume that the equilibrium 
point x9 = 0. (a) Choose e€ > 0 sufficiently small that N,(0) C E and let 
m, be the minimum of the continuous function V(x) on the compact set 


S. = {x ER" | |x| =e}. 


Then since V(x) > 0 for x # 0, it follows that m, > 0. Since V(x) is 
continuous and V(0) = 0, it follows that there exists a 6 > 0 such that 
|x| < 6 implies that V(x) < m,. Since V(x) < 0 for x € E, it follows that 
V(x) is decreasing along trajectories of (1). Thus, if @, is the flow of the 
differential equation (1), it follows that for all x9 € Ns(0) and t > 0 we 
have 


V(@,(X0)) S V(xX0) < me. 


Now suppose that for |xo| < 6 there is a t; > 0 such that |¢,, (xo)| = €; 
i.e., such that $; (xo) € S-. Then since m, is the minimum of V(x) on S,, 
this would imply that 


V(t, (X0)) 2 Me 


which contradicts the above inequality. Thus for |xo| < 6 and t > 0 it 
follows that |@,(xo0)| < €; i-e., O is a stable equilibrium point. 

(b) Suppose that V(x) < 0 for all x € E. Then V(x) is strictly decreas- 
ing along trajectories of (1). Let @, be the flow of (1) and let x9 € Ng(0), 
the neighborhood defined in part (a). Then, by part (a), if |xo| < 6, 
$,(xo) C Ne(O) for all t > 0. Let {t,} be any sequence with t, — oo. 
Then since N, (0) is compact, there is a subsequence of {@,, (xo)} that con- 
verges to a point in N.(0). But for any subsequence {¢,,} of {t;,} such that 
{%,_ (xo)} converges, we show below that the limit is zero. It then follows 
that ¢,, (xo) — 0 for any sequence t;, — oo and therefore that $,(xo) — 0 
as t — 00; i.e., that 0 is asymptotically stable. It remains to show that if 
$,,,(X0) — Yo, then yo = O. Since V(x) is strictly decreasing along tra- 
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jectories of (1) and since V(q¢,_(Xo)) — V(yo) by the continuity of V, it 
follows that 
V($,(x0)) > V(yo) 


for all t > 0. But if yo # 0, then for s > 0 we have V(@,(yo)) < V(yo) 
and, by continuity, it follows that for all y sufficiently close to yo we have 
V(o,(y)) < V(yo) for s > 0. But then for y = ¢, (Xo) and n sufficiently 
large, we have 

V(bs41, (X0)) < V(yo) 


which contradicts the above inequality. Therefore yo = O and it follows 
that 0 is asymptotically stable. 

(c) Let M be the maximum of the continuous function V(x) on the 
compact set N.(0). Since V(x) > 0, V(x) is strictly increasing along tra- 
jectories of (1). Thus, if @, is the flow of (1), then for any 6 > 0 and 
xo € Ns(O) ~ {0} we have 


V(,(X0)) > V(x0) > 0 


for all t > 0. And since V(x) is positive definite, this last statement implies 
that 


inf V($4(x0)) =m>0. 
Thus, 

V(o(X0)) — V(x0) 2 mt 
for all t > 0. Therefore, 


V(@,(X0)) > mt > M 


for t sufficiently large; i.e., @,(xo) lies outside the closed set N-(0). Hence, 
0 is unstable. 


Remark. If V(x) = 0 for all x € E then the trajectories of (1) lie on the 
surfaces in R” (or curves in R”) defined by 


V(x) =c. 
Example 1. Consider the system 

Z) = —2x3 

2 = xz. 


The origin is a nonhyperbolic equilibrium point of this system and 
V(x) =a} +25 
is a Liapunov function for this system. In fact 


V (x) = 4r?z) oi 4x32 = 0. 
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Hence the solution curves lie on the closed curves 


zi +23 =? 


which encircle the origin. The origin is thus a stable equilibrium point of 
this system which is not asymptotically stable. Note that Df(0) = 0 for 
this example; i.e., Df(0) has two zero eigenvalues. 


Example 2. Consider the system 


ZL) = —279+ 7073 
fq = 2, — 7173 


23 = 222. 


The origin is an equilibrium point for this system and 


0 -2 0 
Df(0)=|1 0 0 
0 00 


Thus Df(0) has eigenvalues A; = 0, A2,3 = £22; i-e., x = O is a nonhyper- 
bolic equilibrium point. So we use Liapunov’s method. But how do we find 
a suitable Liapunov function? A function of the form 


V(x) = cir? + cox? + cgzr3 


with positive constants c;, cp and c3 is usually worth a try, at least when 
the system contains some linear terms. Computing V(x) = DV(x)f(x), we 
find 

] 

2 
Hence if cg = 2c; and cz = c; > 0 we have V(x) > 0 for x # O and 
V(x) = 0 for all x € R® and therefore by Theorem 3, x = 0 is stable. 
Furthermore, choosing c; = c3 = 1 and c2 = 2, we see that the trajectories 
of this system lie on the ellipsoids +? + 222 + x2 = c?. 

We commented earlier that all sinks are asymptotically stable. However, 
as the next example shows, not all asymptotically stable equilibrium points 
are sinks. (Of course, a hyperbolic equilibrium point is asymptotically stable 
iff it is a sink.) 


V(x) = (cy — co + C3) 21 LQr3 + (—2c; + c2)2122. 


Example 3. Consider the following modification of the system in Exam- 
ple 2: 

Ly = —272 + For3 — xz 

Lo = 27, — 21273 —-— 3 


3 = 2)22—- zr. 
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The Liapunov function of Example 2, 
V(x) = 2? + 272 + 22, 
satisfies V(x) > 0 and 
V(x) = -2(24 + 224 + 24) < 0 


for x # 0. Therefore, by Theorem 3, the origin is asymptotically stable, 
but it is not a sink since the eigenvalues A, = 0, A23 = £27 do not have 
negative real part. 


Example 4. Consider the second-order differential equation 
~+ q(x) =0 


where the continuous function q(z) satisfies xq(z) > 0 for z # 0. This 
differential equation can be written as the system 


ZL) = 22 
Zo = —q(21) 


where z, = =z. The total energy of the system 
x2 Z1 
V(x) = +/ q(s) ds 
2 Jo 


which is the sum of the kinetic energy 4? and the potential energy) serves 
21 
as a Liapunov function for this system. 


V(x) = q(z1)z2 + Z2[—9(x1)] = 0. 


The solution curves are given by V(x) = c; i.e., the energy is constant on 
the solution curves or trajectories of this system; and the origin is a stable 
equilibrium point. 


PROBLEM SET 9 


1. Discuss the stability of the equilibrium points of the systems in Prob- 
lem 1 of Problem Set 6. 


2. Determine the stability of the equilibrium points of the system (1) 
with f(x) given by 


(3) " fom J 


I2- x? +2 
(b) |. 
Lo — 22,22 
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—47, — 270 + 4 
(c) J | 

122 

3. Use the Liapunov function V(x) = xz? + 22 + 22 to show that the 
origin is an asymptotically stable equilibrium point of the system 
—%2- rr + 2 = xz 
x= m1 +23-23 
—-7 173 — 1327 = rors = r2 

Show that the trajectories of the linearized system x = Df(0)x for 
this problem lie on circles in planes parallel to the x;, x2 plane; hence, 


the origin is stable, but not asymptotically stable for the linearized 
system. 


4. It was shown in Section 1.5 of Chapter 1 that the origin is a center 
for the linear system 
. _ |O -1 


The addition of nonlinear terms to the right-hand side of this linear 
system changes the stability of the origin. Use the Liapunov function 
V(x) = r? + 22 to establish the following results: 


(a) The origin is an asymptotically stable equilibrium point of 
. {0 -1 —z} — mat 
x= x + 
f 4 oS — £22} 
(b) The origin is an unstable equilibrium point of 
0 - 3 2 
x= | gx+ [2h cia. 
1 0 Lo + Tor} 


(c) The origin is a stable equilibrium point which is not asymptoti- 


cally stable for 
_ 0 -1l —2172 
x=) o| x + 23 
What are the solution curves in this case? 


5. Use appropriate Liapunov functions to determine the stability of the 
equilibrium points of the following systems: 


DZ) = —-2%, + 22+ 2122 
to = 2, —22—-27-23 


(a) 
2) =2, — 329+ 2° 


fo = —2, + 22 — 22 


(b) 
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ZL} = —-2Z1— 229 + rr 


(c) 


LQ = 32, — 322 +23 
Ly = —42r9 +2? 


(d) 


Lo = 42, +22 


6. Let A(t) be a continuous real-valued square matrix. Show that every 


solution of the nonautonomous linear system 
x = A(t)x 
satisfies 
Px(®1 < be(O)lexp f IACs)Ih as. 


And then show that if i || A(s)|] ds < 00, then every solution of this 
system has a finite limit as t approaches infinity. 


. Show that the second-order differential equation 


£+ f(r)z+9(xz) =0 
can be written as the Lienard system 
t, = 22 — F(z) 
£2 = —g(21) 
where n 
F(2;) =[ f(s) ds. 
Let x 
G(a)= | o(s) ds 


and suppose that G(z) > 0 and g(z)F(z) > 0 (or g(x)F(z) < 0) 
in a deleted neighborhood of the origin. Show that the origin is an 
asymptotically stable equilibrium point (or an unstable equilibrium 
point) of this system. 


8. Apply the previous results to the van der Pol equation 


#+e(x? -1)t+2=0. 


2.10 Saddles, Nodes, Foci and Centers 


In Section 1.5 of Chapter 1, a linear system 


x = Ax (1) 
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where x € R? was said to have a saddle, node, focus or center at the origin 
if its phase portrait was linearly equivalent to one of the phase portraits in 
Figures 1-4 in Section 1.5 of Chapter 1 respectively; i.e., if there exists a 
nonsingular linear transformation which reduces the matrix A to one of the 
canonical matrices B in Cases I-IV of Section 1.5 in Chapter 1 respectively. 
For example, the linear system (1) of the example in Section 2.8 of this 
chapter has a saddle at the origin. 
In Section 2.6, a nonlinear system 


x = f(x) (2) 


was said to have a saddle, a sink or a source at a hyperbolic equilibrium 
point Xo if the linear part of f at x9 had eigenvalues with both positive and 
negative real parts, only had eigenvalues with negative real parts, or only 
had eigenvalues with positive real parts, respectively. 

In this section, we define the concept of a topological saddle for the 
nonlinear system (2) with x € R? and show that if x9 is a hyperbolic 
equilibrium point of (2) then it is a topological saddle if and only if it 
is a saddle of (2); i.e., a hyperbolic equilibrium point xo is a topological 
saddle for (2) if and only if the origin is a saddle for (1) with A = Df(xp9). 
We discuss topological saddles for nonhyperbolic equilibrium points of (2) 
with x € R? in the next section. We also refine the classification of sinks of 
the nonlinear system (2) into stable nodes and foci and show that, under 
slightly stronger hypotheses on the function f, i.e., stronger than f € C!(E), 
a hyperbolic critical point x9 is a stable node or focus for the nonlinear 
system (2) if and only if it is respectively a stable node or focus for the 
linear system (1) with A = Df(xo). Similarly, a source of (2) is either an 
unstable node or focus of (2) as defined below. Finally, we define centers and 
center-foci for the nonlinear system (2) and show that, under the addition 
of nonlinear terms, a center of the linear system (1) may become either a 
center, a center-focus, or a stable or unstable focus of (2). 

Before defining these various types of equilibrium points for planar sys- 
tems (2), it is convenient to introduce polar coordinates (r,@) and to rewrite 
the system (2) in polar coordinates. In this section we let x = (z,y)’, 
fi(x) = P(z,y) and fo(x) = Q(z,y). The nonlinear system (2) can then 
be written as 

z= P(z,y) 
y= Q(z, y). (3) 


If we let r? = x? + y? and 6 = tan~!(y/z), then we have 
rr = 7r+ yy 


and 


r?9 = LY — yr. 
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It follows that for r > 0, the nonlinear system (3) can be written in terms 
of polar coordinates as 


t = P(rcos6,rsin@) cos@ + Q(r cos 98, r sin @) sin 8 


4 
r@ = Q(rcos8@,rsin 6) cos 6 — P(rcos6,r sin 6) sin 6 (4) 


or as 
dr F(r,6) = r{[P(r cos 0@,r sin 8) cos 6 + Q(r cos @,r sin 6) sin 6] (5) 
d@ =’ *~— ~Q(rcos@,rsin@)cos@ — P(rcos0,rsin@)sinO ” 


Writing the system of differential equations (3) in polar coordinates will 
often reveal] the nature of the equilibrium point or critical point at the 
origin. This is illustrated by the next three examples; cf. Problem 4 in 
Problem Set 9. 


Example 1. Write the system 


Z=-y-—ry 


y=artsr? 
in polar coordinates. For r > 0 we have 


_rityy _ —Zy-—TZ zy + ry +2? y _ 


and 
6-7 yr _ x? + 2° ty + ry? 
r2 r2 

for x > —1. Thus, along any trajectory of this system in the half plane 
x > —1, 7r(t) is constant and @(t) increases without bound as t — oo. That 
is, the phase portrait in a neighborhood of the origin is equivalent to the 
phase portrait in Figure 4 of Section 1.5 in Chapter 1 and the origin is 
called a center for this nonlinear system. 


=l+z>0 


Example 2. Consider the system 


¢=-y-—2°—2y’ 


yor—y—2’y. 
In polar coordinates, for r > 0, we have 


f=-—r* 


and 
6=1. 


Thus r(t) = ro(1+ 2rZt)—}/? for t > —1(2r2) and 0(t) = 09 +t. We see that 
r(t) — 0 and 0(t) — co as t — oo and the phase portrait for this system in 
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a neighborhood of the origin is qualitatively equivalent to the first figure 
in Figure 3 in Section 1.5 of Chapter 1. The origin is called a stable focus 
for this nonlinear system. 


Example 3. Consider the system 


¢=—-y+2342y? 
y=rtytcr’y. 


In this case, we have for r > 0 


and 


6=1. 


Thus, r(t) = ro(1 — 272t)—!/? for t < 1/(2r2) and 0(t) = 09 +t. We see that 
r(t) — 0 and |6(t)| —- >0 as t — —oo. The phase portrait in a neighborhood 
of the origin is qualit tively equivalent to the second figure in Figure 3 in 
Section 1.5 of Chapter 1 with the arrows reversed and the origin is called 
an unstable focus for this nonlinear system. 

We now give precise geometrical definitions for a center, a center-focus, 
a stable and unstable focus, a stable and unstable node and a topological 
saddle of the nonlinear system (3). We assume that x9 € R? is an isolated 
equilibrium point of the nonlinear system (3) which has been translated to 
the origin; r(t, ro, 9) and 0@(t, ro, 40) will denote the solution of the nonlin- 
ear system (4) with r(0) = ro and 0(0) = 4. 


Definition 1. The origin is called a center for the nonlinear system (2) 
if there exists a 6 > 0 such that every solution curve of (2) in the deleted 
neighborhood N5(0) ~ {0} is a closed curve with 0 in its interior. 


Definition 2. The origin is called a center-focus for (2) if there exists a 
sequence of closed solution curves [,, with [,,4; in the interior of I, such 
that [,, — 0 as n — oo and such that every trajectory between [,, and 
[n+1 Spirals toward I, or [y4) as t — too. 


Definition 3. The origin is called a stable focus for (2) if there exists 
a 6 > 0 such that for 0 < ro < 6 and % € R, r(t,ro,90) — O and 
|A(t, ro, 99)| —- co as t — oo. It is called an unstable focus if r(t,ro,09) — 0 
and |@(t,ro,0)| —- co as t — —oo. Any trajectory of (2) which satisfies 
r(t) — 0 and |0(t)| — co as t — +00 is said to spiral toward the origin as 
t — 00. 


Definition 4. The origin is called a stable node for (2) if there exists a 
6 > 0 such that for 0 < ro < 6 and 4 € R, r(t,ro,49) — 0 as t — 00 and 
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jim. O(t, ro, 99) exists; i.e., each trajectory in a deleted neighborhood of the 


origin approaches the origin along a well-defined tangent line as t — oo. 
The origin is called an unstable node if r(t,ro,99) ~~ 0 as t + —oo and 
jim O(t, ro, 90) exists for all ro € (0,5) and 0 € R. The origin is called 


a proper node for (2) if it is a node and if every ray through the origin is 
tangent to some trajectory of (2). 


Definition 5. The origin is a (topological) saddle for (2) if there exist two 
trajectories [; and [2 which approach 0 as t — oo and two trajectories [3 
and [4 which approach 0 as t — —oo and if there exists a 6 > 0 such that 
all other trajectories which start in the deleted neighborhood of the origin 
Ng(0) ~ {0} leave Ns(0) as t — too. The special trajectories T,,...,T4 
are called separatrices. 


For a (topological) saddle, the stable manifold at the origin S = T, U 
[2 U {0} and the unstable manifold at the origin U = [3 UI, U {0}. If the 
trajectory [; approaches the origin along a ray making an angle 0; with the 
z-axis where 0; € (—7, 7] fori =1,...,4, then 02 = 0, +7 and 64 = 6347. 
This follows by considering the possible directions in which a trajectory 
of (2), written in polar form (4), can approach the origin; cf. equation (6) 
below. The following theorems, proved in [A-I], are useful in this regard. 
The first theorem is due to Bendixson [B]. 


Theorem 1 (Bendixson).Let E be an open subset of R® containing the 
origin and let f € C'(E). If the origin is an isolated critical point of (2), 
then either every neighborhood of the origin contains a closed solution curve 
with O in its interior or there exists a trajectory approaching 0 as t — +oo. 


Theorem 2. Suppose that P(z,y) and Q(z, y) in (3) are analytic functions 
of x and y in some open subset E of R? containing the origin and suppose 
that the Taylor expansions of P and Q about (0,0) begin with mth-degree 
terms Pm(z,y) and Qm(z,y) with m > 1. Then any trajectory of (3) which 
approaches the origin as t — oo either spirals toward the origin ast - 
oo or it tends toward the origin in a definite direction 06 = 0) ast — 
oo. If tQm(z,y) — yPm(z, y) is not identically zero, then all directions of 
approach, 0, satisfy the equation 


COS 99 Qm(cos 90, sin 99) — sin 997 Pm(cos 90, sin 99) = 0. 


Furthermore, if one trajectory of (3) spirals toward the origin as t —+ oo 
then all trajectories of (3) in a deleted neighborhood of the origin spiral 
toward 0 as t — oo. 


It follows from this theorem that if P and Q begin with first-degree 
terms, i.e., if 


P,(z,y) = ax + by 
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and 
Qi(z,y) = cx + dy 


with a, b, c and d not all zero, then the only possible directions in which 
trajectories can approach the origin are given by directions @ which satisfy 


bsin? 0 + (a — d)sin8@cos6 — ccos? 6 = 0. (6) 
For cos @ # 0 in this equation, i.e., if b 4 0, this equation is equivalent to 
btan? 6 + (a — d)tand —c=0. (6’) 


This quadratic has at most two solutions 0 € (—7/2, 7/2] and if 6 = 0; isa 
solution then 0 = 6, + 7 are also solutions. Finding the solutions of (6’) is 
equivalent to finding the directions determined by the eigenvectors of the 


matrix : 
a 
ae h ‘ | 


The next theorem follows immediately from the Stable Manifold Theo- 
rem and the Hartman-Grobman Theorem. It establishes that if the origin 
is a hyperbolic equilibrium point of the nonlinear system (2), then it is a 
(topological) saddle for (2) if and only if it is a saddle for its linearization 
at the origin. Furthermore, the directions 6; along which the separatrices 
I; approach the origin are solutions of (6). 


Theorem 3. Suppose that E is an open subset of R? containing the origin 
and that f € C'(E). If the origin is a hyperbolic equilibrium point of the 
nonlinear system (2), then the origin is a (topological) saddle for (2) if and 
only if the origin is a saddle for the linear system (1) with A = Df(0). 
Example 4. According to the above theorem, the origin is a (topological) 
saddle or saddle for the nonlinear system 


t=xr+22+2?-y? 
y = 32 + 4y — Ary 


since the determinant of the linear part 6 = —2; cf. Theorem 1 in Sec- 
tion 1.5 of Chapter 1. Furthermore, the directions in which the separatrices 
approach the origin as t — +00 are given by solutions of (6’): 


2tan? 6 — 3tand —3=0. 


@=tan! (22 4 
4 


and we have 0; ~ 65.42°, 03 ~ —34.46°. At any point on the positive z-axis 
near the origin, the vector field defined by this system points upward since 


That is, 


142 2. Nonlinear Systems: Local Theory 


y > 0 there. This determines the direction of the flow defined by the above 
system. The local phase portraits for the linear part of this vector field 
as well as for the nonlinear system are shown in Figure 1. The qualitative 
behavior in a neighborhood of the origin is the same for either system. 
The next example, due to Perron, shows that a node for a linear system 
may change to a focus with the addition of nonlinear terms. Note that the 


PNG | EN 


Figure 1. A saddle for the linear system and a topological saddle for the 
nonlinear system of Example 4. 


vector field defined in this example f € C!(R?) but that f ¢ C?(R?); cf. 
Problem 2 at the end of this section. This example shows that the hypoth- 
esis f € C!(E) is not strong enough to imply that the phase portrait of a 
nonlinear system (2) is diffeomorphic to the phase portrait of its lineariza- 
tion. (Hartman’s Theorem at the end of Section 2.8 shows that f € C?(E) 
is sufficient.) 


Example 5. Consider the nonlinear system 


y 


In Vz? +y? 


r 
En oleae 
nis In fz? + y? 


for x? + y? # 0 and define f(0) = 0. In polar coordinates we have 


r=-cz 


7 
) 


—r 
i 
Inr 
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Thus, r(t) = roe~* and @(t) = 69 — In(1 — t/Inro). We see that for ro < 1, 
r(t) — 0 and |6(t)| — 00 as t — oo and therefore, according to Definition 4, 
the origin is a stable focus for this nonlinear system; however, it is a stable 
proper node for the linearized system. 

The next theorem, proved in [A-I], shows that under the stronger hy- 
pothesis that f € C?(E), i.e., under the hypothesis that P(z, y) and Q(z, y) 
have continuous second partials in a neighborhood of the origin, we find 
that nodes and foci of a linear system persist under the addition of nonlin- 
ear terms. Cf. Hartman’s Theorem at the end of Section 2.8. 


Theorem 4. Let E be an open subset of R? containing the origin and let 
f € C*(E). Suppose that the origin is a hyperbolic critical point of (2). 
Then the origin is a stable (or unstable) node for the nonlinear system (2) 
if and only if it is a stable (or unstble) node for the linear system (1) with 
A = Df(0). And the origin is a stable (or unstable) focus for the nonlinear 
system (2) if and only if it is a stable (or unstable) focus for the linear 
system (1) with A = Df(0). 


Remark. Under the hypotheses of Theorem 4, it follows that the origin 
is a proper node for the nonlinear system (2) if and only if it is a proper 
node for the linear system (1) with A = Df(0). And under the weaker 
hypothesis that f € C'(E), it still follows that if the origin is a focus for 
the linear system (1) with A = Df(0), then it is a focus for the nonlinear 
system (2); cf. [C/L]. 

Examples 1-3 above show that a center for a linear system can either 
remain a center or change to a stable or an unstable focus with the addition 
of nonlinear terms. The following example shows that a center for a linear 
system may also become a center-focus under the addition of nonlinear 
terms; and the following theorem shows that these are the only possibilities. 


Example 6. Consider the nonlinear system 


£=—yt+ar/2? + y* sin(1//2r? + y?) 
y= oty 2? + y?sin(1/ V2? + y?) 


for x2 + y? #0 where we define f(0) = 0. In polar coordinates, we have 


* =r’ sin(1/r) 


d=1 


for r > 0 with ¢ = 0 at r = 0. Clearly, r = 0 for r = 1/(nzm); i.e., each 
of the circles r = 1/(n7) is a trajectory of this system. Furthermore, for 
nt < l/r < (n+1)z, f < 0 if n is odd and r > 0 if n is even; i.e., the 
trajectories between the circles r = 1/(n7) spiral inward or outward to 
one of these circles. Thus, we see that the origin is a center-focus for this 
nonlinear system according to Definition 2 above. 
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Theorem 5. Let E be an open subset of R? containing the origin and 
let f € C'(E) with f(0) = 0. Suppose that the origin is a center for the 
linear system (1) with A = Df(0). Then the origin is either a center, a 
center-focus or a focus for the nonlinear system (2). 


Proof. We may assume that the matrix A = Df(0) has been transformed 
to its canonical form 
reo 
~ 1b 0 


with b 4 0. Assume that b > 0; otherwise we can apply the linear transfor- 
mation t — —t. The nonlinear system (3) then has the form 


r= —by + p(z, y) 
y = br + q(z,y). 


Since f € C'(E), it follows that |p(z,y)/r| — 0 and |q(z,y)/r| — 0 as 
r — 0; i.e., p = o(r) and q = o(r) as r — 0. Cf. Problem 3. Thus, in polar 
coordinates we have 7 = o(r) and 0 = b+ o(1) as r — 0. Therefore, there 
exists a 6 > 0 such that 6 > b/2 > 0 for0 <r < 6. Thus for 0 < m9 < 6 
and 0) € R, O(t,r0,80) > bt/2 + 09 — oo as t — oo; and A(t, ro, 90) is 
a monotone increasing function of t. Let ¢ = h(@) be the inverse of this 
monotone function. Define 7(6) = r(h(@), ro, 60) for 0 < ro < 6 and 6) € R. 
Then 7(@) satisfies the differential equation (5) which has the form 


dr F(7,0) = cos 8 p(7 cos 6,7 sin 8) + sin 6 q(7 cos 6, 7 sin 8) 
dO ’ b+ (cos 0/7) q(F cos 6,7 sin 0) — (sin 0/7) p(F cos 0, 7 sin 6) 


Suppose that the origin is not a center or a center-focus for the nonlinear 
system (3). Then for 6 > 0 sufficiently small, there are no closed trajectories 
of (3) in the deleted neighborhood Ns(0) ~ {0}. Thus for 0 < ro < 6 and 
0 € R, either 7(09+27) < 7(09) or 7(09+27) > 7(A9). Assume that the first 
case holds. The second case is treated in a similar manner. If r(@9 + 27) < 
7(99) then 7(09 + 2k7) < 7(O9 + 2(k — 1)7) for k = 1,2,3.... Otherwise 
we would have two trajectories of (3) through the same point which is 
impossible. The sequence 7(@9 + 2k77) is monotone decreasing and bounded 
below by zero; therefore, the following limit exists and is nonnegative: 


ie im, T(4o + 2kr). 


If 7, = 0 then 7(8) — 0 as 6 — ©0; i.e., r(t,ro9, 99) — 0 and A(t, r9, 99) — oo 
as t — oo and the origin is a stable focus of (3). If 7; > 0 then since 
|F(r, 0)| < M for0 <r <6 and 0 < @ < 2z7, the sequence r(49 + 8 + 2k7) is 
equicontinuous on [0,27]. Therefore, by Ascoli’s Lemma, cf. Theorem 7.25 
in Rudin [R], there exists a uniformly convergent subsequence of 7 (49 + 6 + 
2k) converging to a solution 7,(6) which satisfies 7, (0) = 7,(@+ 2k7)); i.e., 
71(8) is a non-zero periodic solution of (5). This contradicts the fact that 
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there are no closed trajectories of (3) in Ns(0) ~ {0} when the origin is 
not a center or a center focus of (3). Thus if the origin is not a center or a 
center focus of (3), 7; = 0 and the origin is a focus of (3). This completes 
the proof of the theorem. 


A center-focus cannot occur in an analytic system. This is a consequence 
of Dulac’s Theorem discussed in Section 3.3 of Chapter 3. We therefore 
have the following corollary of Theorem 5 for analytic systems. 


Corollary. Let E be an open subset of R? containing the origin and let f 
be analytic in E with £(0) = 0. Suppose that the origin is a center for the 
linear system (1) with A = Df(0). Then the origin is either a center or a 
focus for the nonlinear system (2). 


As we noted in the previous section, Liapunov’s method is one tool that 
can be used to distinguish a center from a focus for a nonlinear system; 
cf. Problem 4 in Problem Set 9. Another approach is to write the system 
in polar coordinates as in Examples 1-3 above. Yet another approach is to 
look for symmetries in the differential equations. The easiest symmetries 
to see are symmetries with respect to the z and y axes. 


Definition 6. The system (3) is said to be symmetric with respect to the 
z-axis if it is invariant under the transformation (t,y) —> (—t,—y); it is 
said to be symmetric with respect to the y-azis if it is invariant under the 
transformation (t,r) — (—t, —z). 


Note that the system in Example 1 is symmetric with respect to the 
z-axis, but not with respect to the y-axis. 


Theorem 6. Let E be an open subset of R? containing the origin and let 
f € C'(E) with f(0) = 0. If the nonlinear system (2) is symmetric with 
respect to the x-axis or the y-azis, and if the origin is a center for the linear 
system (1) with A = Df(0), then the origin is a center for the nonlinear 
system (2). 


The idea of the proof of this theorem is that by Theorem 5, any trajectory 
of (3) in Ns(0) which crosses the positive z-axis will also cross the negative 
z-axis. If the system (3) is symmetric with respect to the z-axis, then the 
trajectories of (3) in Ns(0) will be symmetric with respect to the z-axis 
and hence all trajectories of (3) in Ns(0) will be closed; i.e., the origin will 


be a center for (3). 
PROBLEM SET 10 


1. Write the following systems in polar coordinates and determine if the 
origin is a center, a stable focus or an unstable focus. 
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L=2-y 
(a) y=rty 
£=-yt+zy? 
b 
©) yerty 
&£=-y+2° 
c 
(0) oe 
2. Let 
—— forz # 0 
In |x 
f(z) = nF 
0 for z=0 
Show that f’(0) = lim f'(z) = 0;ie., f € C'(R), but that f’(0) is 
undefined. 


3. Show that if r = 0 is a zero of the function f: R ~ Rand f € C}(R) 
then 


f(z) = Df(0)z + F(z) 


where |F(xz)/z| — 0 as z — 0. Show that this same result holds for 
f: R? > R?, i.e., show that |F(x)|/|x| — 0 as x — 0. 


Hint: Use Definition 1 in Section 2.1. 


4. Determine the nature of the critical points of the following nonlinear 
systems (Cf. Problem 1 in Section 2.6); be as specific as possible. 


Cee: 

a). 

y=y-2 
r= —4y + 2ry — 8 

(b) = 4 2 pe 
y=ay —2 
z= 22 — Qy 


(c) yar? ty? 

(d) gaz? -y*+1 

y = 22 

(ey f=—P +1 
y = zy 

(f) g=2?-y*-1 
y =2y 
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2.11 Nonhyperbolic Critical Points in R? 


In this section we present some results on nonhyperbolic critical points of 
planar analytic systems. This work originated with Poincaré [P] and was 
extended by Bendixson [B] and more recently by Andronov et al. [A-I]. We 
assume that the origin is an isolated critical point of the planar system 


& = P(z,y) 
y = Q(z, y) () 


where P and Q are analytic in some neighborhood of the origin. In Sec- 
tions 2.9 and 2.10 we have already presented some results for the case when 
the matrix of the linear part A = Df(0) has pure imaginary eigenvalues, 
i.e., when the origin is a center for the linearized system. In this section we 
give some results established in [A-I] for the case when the matrix A has 
one or two zero eigenvalues, but A # 0. And these results are extended to 
higher dimensions in Section 2.12. 

First of all, note that if P and Q begin with mth-degree terms P,, and 
Qm, then it follows from Theorem 2 in Section 2.10 that if the function 


g(8) = cos 8 Q,,(cos 8, sin 8) — sin @ P,,(cos 8, sin 8) 


is not identically zero, then there are at most 2(m + 1) directions 0 = 0 
along which a trajectory of (1) may approach the origin. These directions 
are given by solutions of the equation g(@) = 0. Suppose that g(6) is not 
identically zero, then the solution curves of (1) which approach the origin 
along these tangent lines divide a neighborhood of the origin into a finite 
number of open regions called sectors. These sectors will be of one of three 
types as described in the following definitions; cf. [A-I] or [L]. The trajecto- 
ries which lie on the boundary of a hyperbolic sector are called separatrices. 
Cf. Definition 1 in Section 3.11. 


Definition 1. A sector which is topologically equivalent to the sector 
shown in Figure 1(a) is called a hyperbolic sector. A sector which is topo- 
logically equivalent to the sector shown in Figure 1(b) is called a parabolic 
sector. And a sector which is topologically equivalent to the sector shown 
in Figure 1(c) is called an elliptic sector. 


UG 


Figure 1. (a) A hyperbolic sector. (b) A parabolic sector. (c) An elliptic 
sector. 
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In Definition 1, the homeomorphism establishing the topological equiv- 
alence of a sector to one of the sectors in Figure 1 need not preserve the 
direction of the flow; i.e., each of the sectors in Figure 1 with the arrows 
reversed are sectors of the same type. For example, a saddle has a deleted 
neighborhood consisting of four hyperbolic sectors and four separatrices. 
And a proper node has a deleted neighborhood consisting of one parabolic 
sector. According to Theorem 2 below, the system 


r=y 
y=—2° + 4zry 


has an elliptic sector at the origin; cf. Problem 1 below. The phase portrait 
for this system is shown in Figure 2. Every trajectory which approaches 
the origin does so tangent to the z-axis. 

A deleted neighborhood of the origin consists of one elliptic sector, one 
hyperbolic sector, two parabolic sectors, and four separatrices. Cf. Defini- 
tion 1 and Problem 5 in Section 3.11. This type of critical point is called a 
critical point with an elliptic domain; cf. [A-I]. 


Figure 2. A critical point with an elliptic domain at the origin. 
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Another type of nonhyperbolic critical point for a planar system is a 
saddle-node. A saddle-node consists of two hyperbolic sectors and one 
parabolic sector (as well as three separatrices and the critical point itself). 
According to Theorem 1 below, the system 


t=2" 


y=y 
has a saddle-node at the origin; cf. Problem 2. Even without Theorem 1, 
this system is easy to discuss since it can be solved explicitly for x(t) = 


(1/z9 — t)~' and y(t) = yoe*. The phase portrait for this system is shown 
in Figure 3. 


Figure 3. A saddle-node at the origin. 


One other type of behavior that can occur at a nonhyperbolic critical 
point is illustrated by the following example: 


=y 
y=r’. 
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The phase portrait for this system is shown in Figure 4. We see that a 
deleted neighborhood of the origin consists of two hyperbolic sectors and 
two separatrices. This type of critical point is called a cusp. 

As we shall see, besides the familiar types of critical points for planar 
analytic systems discussed in Section 2.10, i.e., nodes, foci, (topological) 
saddles and centers, the only other types of critical points that can occur 
for (1) when A # 0 are saddle-nodes, critical points with elliptic domains 
and cusps. 

We first consider the case when the matrix A has one zero eigenvalue, 
i.e., when det A = 0, but tr A # 0. In this case, as in Chapter 1 and as is 
shown in {A-I] on p. 338, the system (1) can be put into the form 


t= po(z,y) 

2 

y=y+ Q(z, y) 2) 
where po and qo are analytic in a neighborhood of the origin and have 


expansions that begin with second-degree terms in x and y. The following 
theorem is proved on p. 340 in {A-I]. Cf. Section 2.12. 


-_ 


Ce 


Figure 4. A cusp at the origin. 
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Theorem 1. Let the origin be an isolated critical point for the analytic 
system (2). Let y = $(z) be the solution of the equation y + qo(z,y) =0 in 
a neighborhood of the origin and let the expansion of the function w(z) = 
p2(z,(z)) in a neighborhood of x = 0 have the form (zr) = anz™ + -:: 
where m > 2 and ay, # 0. Then (1) for m odd and a,, > 0, the origin is 
an unstable node, (2) for m odd and a, < 0, the origin is a (topological) 
saddle and (3) for m even, the origin is a saddle-node. 


Next consider the case when A has two zero eigenvalues, i.e., det A = 0, 
tr A = 0, but A # 0. In this case it is shown in [A-I], p. 356, that the 
system (1) can be put in the “normal” form 


Z=y 


y = a,r*[1 + h(z)] + bax" y[1 + g(z)] + y°R(z,y) (3) 


where h(x), g(x) and R(z, y) are analytic in a neighborhood of the origin, 
h(0) = g(0) = 0, k > 2, a, #0 and n > 1. Cf. Section 2.13. The next two 
theorems are proved on pp. 357-362 in [A-]]. 


Theorem 2. Let k = 2m+1 withm > 1 in (3) and let \ = b2 +4(m+1)ax. 
Then if ax, > 0, the origin is a (topological) saddle. If a; <0, the origin is 
(1) a focus or a center if b, = 0 and also if b, #0 andn>m orifn=m 
and X < 0, (2) a node if b, #0, n is an even number and n < m and also 
if bn #0, n is an even number, n = m and A > 0 and (3) a critical point 
with an elliptic domain if b, # 0, n is an odd number and n < m and also 
if b, #0, n is an odd number, n =m and A> 0. 


Theorem 3. Let k = 2m with m > 1 in (3). Then the origin is (1) a cusp 
if b, = 0 and also if b, # 0 and n > m and (2) a saddle-node if b, 4 0 
andn <m. 


We see that if Df(x) has one zero eigenvalue, then the critical point xo 
is either a node, a (topological) saddle, or a saddle-node; and if Df(xo) has 
two zero eigenvalues, then the critical point x9 is either a focus, a center, a 
node, a (topological) saddle, a saddle-node, a cusp, or a critical point with 
an elliptic domain. 

Finally, what if the matrix A = 0? In this case, the behavior near the 
origin can be very complex. If P and Q begin with mth-degree terms, then 
the separatrices may divide a neighborhood of the origin into 2(m + 1) 
sectors of various types. The number of elliptic sectors minus the number 
of hyperbolic sectors is always an even number and this number is related 
to the index of the critical point discussed in Section 3.12 of Chapter 3. 
For example, the homogenous quadratic system 


g=2°+zry 


= 
y= 59 y 
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has the phase portrait shown in Figure 5. There are two elliptic sectors and 
two parabolic sectors at the origin. All possible types of phase portraits 
for homogenous, quadratic systems have been classified by the Russian 
mathematician L.S. Lyagina [19]. For more information on the topic, cf. 
the book by Nemytskii and Stepanov [N/S]. 


Remark. A critical point, x9, of (1) for which Df(xo) has a zero eigenvalue 
is often referred to as a multiple critical point. The reason for this is made 
clear in Section 4.2 of Chapter 4 where it is shown that a multiple critical 
point of (1) can be made to split into a number of hyperbolic critical points 
under a suitable perturbation of (1). 


Figure 5. A nonhyperbolic critical point with two elliptic sectors and two 
parabolic sectors. 


PROBLEM SET 11 
1. Use Theorem 2 to show that the system 
rl=y 
y= —2z° + 4zry 
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has a critical point with an elliptic domain at the origin. Note that 
y = z7/(2+ V2) are two invariant curves of this system which bound 
two parabolic sectors. 


2. Use Theorem 1 to determine the nature of the critical point at the 
origin for the following systems: 


r=2 
a 
ay 
2 2 
r=a27°+y 
(b) 2 
y=y-72z 
2 3 
r=y +2 
(c) 2 
y=y-Zz 
2 3 
r=y-2 
(d) 2 
y=y-Tt 
¢=y?+c4 
(e) -_ 2 2 
y=y-rt+y 
¢=y?— 2! 
(f) 2442 
y=y-rt+y 


3. Use Theorem 2 or Theorem 3 to determine the nature of the critical 
point at the origin for the following systems: 


(9s) 

(b) ie ee ee 
Qo tie 

(4) gS — ay 

() a3 ay 
a 


Hint: For part (f), let € = z and 7 = z+ y to put the system in the 
form (3). 
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2.12 Center Manifold Theory 


In Section 2.8 we presented the Hartman-—Grobman Theorem, which showed 
that, in a neighborhood of a hyperbolic critical point xo € E, the nonlinear 
system 


x = f(x) (1) 
is topologically conjugate to the linear system 
x = Ax, (2) 


with A = Df(xo), in a neighborhood of the origin. The Hartman-Grobman 
Theorem therefore completely solves the problem of determining the sta- 
bility and qualitative behavior in a neighborhood of a hyperbolic critical 
point of a nonlinear system. In the last section, we gave some results for 
determining the stability and qualitative behavior in a neighborhood of a 
nonhyperbolic critical point of the nonlinear system (1) with x € R? where 
det A = 0 but A # 0. In this section, we present the Local Center Manifold 
Theorem, which generalizes Theorem 1 of the previous section to higher 
dimensions and shows that the qualitative behavior in a neighborhood of 
a nonhyperbolic critical point xo of the nonlinear system (1) with x € R” 
is determined by its behavior on the center manifold near xo. Since the 
center manifold is generally of smaller dimension than the system (1), this 
simplifies the problem of determining the stability and qualitative behavior 
of the flow near a nonhyperbolic critical point of (1). Of course, we still 
must determine the qualitative behavior of the flow on the center manifold 
near the hyperbolic critical point. If the dimension of the center manifold 
W°(xo) is one, this is trivial; and if the dimension of W°(x9) is two and 
a linear term is present in the differential equation determining the flow 
on W“(xo), then Theorems 2 and 3 in the previous section or the method 
in Section 2.9 can be used to determine the flow on W°(x9). The remain- 
ing cases must be treated as they appear; however, in the next section we 
will present a method for simplifying the nonlinear part of the system of 
differential equations that determines the flow on the center manifold. 
Let us begin as we did in the proof of the Stable Manifold Theorem in 
Section 2.7 by noting that if f € C'(E) and f(0) = O, then the system 
(1) can be written in the form of equation (6) in Section 2.7 where, in this 
case, the matrix A = Df(0) = diag[{C, P,Q] and the square matrix C has 
c eigenvalues with zero real parts, the square matrix P has s eigenvalues 
with negative real parts, and the square matrix Q has u eigenvalues with 
positive rea] parts; i.e., the system (1) can be written in diagonal form 


x = Cx + F(x, y, 2) 
y = Py + G(x, y,z) (3) 
z= Qz+H(x,y,z), 


where (x,y,z) € R° x R* x R", F(0) = G(0) = H(0) = 0, and DF(0) = 
DG(0) = DH(0) = O. 
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We first shall present the theory for the case when u = 0 and treat 
the general case at the end of this section. In the case when u = Q, it 
follows from the center manifold theorem in Section 2.7 that for (F,G) € 
C’(E) with r > 1, there exists an s-dimensional invariant stable manifold 
W°(0) tangent to the stable subspace E* of (1) at O and there exists a c- 
dimensional invariant center manifold W°(0) tangent to the center subspace 
E* of (1) at 0. It follows that the local center manifold of (3) at 0, 


Wio-(9) = {(x, y) € R° x R® | y = h(x) for |x| < 6} (4) 


for some 6 > 0, where h € C’(Ng(0)), h(O) = 0, and Dh(0) = O since 
W<(0) is tangent to the center subspace E* = {(x,y) € R° x R* | y = 0} 
at the origin. This result is part of the Local Center Manifold Theorem, 
stated below, which is proved by Carr in [Cal]. 


Theorem 1 (The Local Center Manifold Theorem). Let f € C"(E), where 
E is an open subset of R" containing the origin and r > 1. Suppose that 
f(0) = O and that Df(0) has c eigenvalues with zero real parts and s 
eigenvalues with negative real parts, where c +s =n. The system (1) then 
can be written in diagonal form 


x = Cx + F(x,y) 
y = Py + G(x, y), 


where (x,y) € R° x R°, C is a square matriz with c eigenvalues having 
zero real parts, P is a square matrix with s eigenvalues with negative real 
parts, and F(0) = G(0) = 0, DF(0) = DG(0) = O; furthermore, there 
exists a 6 > 0 and a function h € C™(Ng(0)) that defines the local center 
manifold (4) and satisfies 


Dh(x)(Cx + F(x, h(x))] — Ph(x) — G(x, h(x)) =0 (5) 


for |x| < 6; and the flow on the center manifold W‘(0) is defined by the 
system of differential equations 


x = Cx + F(x, h(x)) (6) 
for allx € R° with |x| < 6. 


Equation (5) for the function h(x) follows from the fact that the center 
manifold W‘(0) is invariant under the flow defined by the system (1) by 
substituting x and y from the above differential equations in Theorem 1 
into the equation 


y = Dh(x)x, 


which follows from the chain rule applied to the equation y = h(x) defin- 
ing the center manifold. Even though equation (5) is a quasilinear partial 
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differential equation for the components of h(x), which is difficult if not 
impossible to solve for h(x), it gives us a method for approximating the 
function h(x) to any degree of accuracy that we wish, provided that the 
integer r in Theorem 1 is sufficiently large. This is accomplished by substi- 
tuting the series expansions for the components of h(x) into equation (5); 
cf. Theorem 2.1.3 in [Wi-II]. This is illustrated in the following examples, 
which also show that it is necessary to approximate the shape of the local 
center manifold W<..(0) in order to correctly determine the flow on W“(0) 
near the origin. Before presenting these examples, we note that for c = 1 
and s = 1, the Local Center Manifold Theorem given above is the same 
as Theorem 1 in the previous section (if we let t — —t in equation (2) in 
Section 2.11). Thus, Theorem 1 above is a generalization of Theorem 1 in 
Section 2.11 to higher dimensions. Also, in the case when c = s = 1, as 
in Theorem 1 in Section 2.11, it is only necessary to solve the algebraic 
equation determined by setting the last two terms in equation (5) equal to 
zero in order to determine the correct flow on W*°(0). 

It should be noted that while there may be many different functions h(x) 
which determine different center manifolds for (3), the flows on the various 
center manifolds are determined by (6) and they are all topologically equiv- 
alent in a neighborhood of the origin. Furthermore, for analytic systems, if 
the Taylor series for the function h(x) converges in a neighborhood of the 
origin, then the analytic center manifold y = h(x) is unique; however, not 
all analytic (or polynomial) systems have an analytic center manifold. Cf. 
Problem 4. 


Example 1. Consider the following system with c = s = 1: 


£=2r*y—2° 
y=—ytz’. 


In this case, we have C = O, P = [-1], F(z, y) = z?y — 2°, and G(z,y) = 
z*. We substitute the expansions 


h(x) = az? + br? + 0(z*) ~and Dh(z) = 2az + 3bz? + 0(z*) 
into equation (5) to obtain 
(ax + 3bz? + ---)(azt + br° +---— 2°) +az* + br? +---— 2? =0. 


Setting the coefficients of like powers of x equal to zero yields a— 1 = 0, 
b=0,c=0,.... Thus, 
h(x) = zr? + 0(z°). 


Substituting this result into equation (6) then yields 


z= 21+0(z*) 
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Ye - w5(o) 


W“(o) 


Figure 1. The phase portrait for the system in Example 1. 


on the center manifold W‘(0) near the origin. This implies that the local 
phase portrait is given by Figure 1. We see that the origin is a saddle-node 
and that it is unstable. However, if we were to use the center subspace 
approximation for the local center manifold, i.e., if we were to set y = 0 in 
the first differential equation in this example, we would obtain 


t=-27° 


and arrive at the incorrect conclusion that the origin is a stable node for 
the system in this example. 

The idea in Theorem 1 in the previous section now becomes apparent 
in light of the Local Center Manifold Theorem; i.e., when the flow on the 
center manifold has the form 


near the origin, then for m even (as in Example 1 above) equation (2) 
in Section 2.11 has a saddle-node at the origin, and for m odd we get a 
topological saddle or a node at the origin, depending on whether the sign 
of a,, is the same as or the opposite of the sign of y near the origin. 
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Example 2. Consider the following system with c = 2 and s = 1: 


: 2 
DZ} = DY — W179 
: 2 
Z2 = Tay — ToT, 


y= —yt+z? +22. 


In this example, we have C = O, P = [-1], 


2 
Dy — 22 
F(x, y) = ( :) and G(x,y) = 2? +23. 
T2y — T27\ 


We substitute the expansions 
h(x) = az? + ba, x2 + cr? + 0(|x|*) 


and 
Dh(x) = [2ax, + bro, bx, + 2cx2] + 0(|x|*) 


into equation (5) to obtain 


(2azr, + bx2)(x, (az? + b2,22o + cx?) — 23] 
+ (br, + 2cx2)[r2(ax? + br x2 + cx?) — r2z3] 
+ (ax? + br, x2 + cx) — (x? + £2) + 0(|x|*) = 0. 
Since this is an identity for all x,,22 with |x| < 5, we obtain a = 1, b=0, 
c=1,.... Thus, 
h(21,22) = 27 +23 + 0((x|*). 
Substituting this result into equation (6) then yields 


z, = z} + 0(|x|*) 
2 = £3 + 0(|x|*) 


on the center manifold W°(0) near the origin. Since r7 = r4+24+O(|x|°) > 
0 for 0 < r < 6, this implies that the local phase portrait near the origin 
is given as in Figure 2. We see that the origin is a type of topological 
saddle that is unstable. However, if we were to use the center subspace 
approximation for the loca] center manifold, i.e., if we were to set y = 0 in 
the first two differential equations in this example, we would obtain 


= —2, 23 
Zr = —2or? 


and arrive at the incorrect conclusion that the origin is a stable nonisolated 
critical point for the system in this example. 
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1 


Figure 2. The phase portrait for the system in Example 2. 


Example 3. For our last example, we consider the system 
Zy=2Zaty 
Zg=yt x? 
y= —ytaretcryy. 


The linear part of this system can be reduced to Jordan form by the matrix 
of (generalized) eigenvectors 


10 0 1 0 0 
P=j0 1 -1 with P= |0 1 1]. 
00 1 00 1 


This yields the following system in diagonal form 


Ly = 72 
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to =2}+(ze-y)? +21y 
y=-yt+(r2-y)? +21y 
with c =2,s=1, P=[-1], 


7 t 4 oe (22 + (x2 “y bead 


G(x, y) = (zo — y)? + 21. 


C 


and 


Let us substitute the expansions for h(x) and Dh(x) in Example 2 into 
equation (5) to obtain 


(2az, + br2)r2+ (bx + 2cz2)(x? + (22 —- y)? +2,y]+ (ax? +6222 + cz?) 
— (x2 — ax? — br, x2 — cr2)? — 2, (ax? + bx, x2 + cx2) + 0(|x|*) = 0. 


Since this is an identity for all +,,22 with |x| < 6, we obtain a = 0, b=0, 
oe ere) 


h(x) = 23 + 0(|x|°). 
Substituting this result into equation (6) then yields 


Ly = 22 
Lo = x? + 22 + O(|x|*) 


on the center manifold W°(0) near the origin. 


Theorem 3 in Section 2.11 then implies that the origin is a cusp for 
this system. The phase portrait for the system in this example is therefore 
topologically equivalent to the phase portrait in Figure 3. 

As on pp. 203-204 in [Wi-II], the above results can be generalized to the 
case when the dimension of the unstable manifold u # 0 in the system (3). 
In that case, the local center manifold is given by 


W<.(0) = {(x, y,z) € R° x R’ x R® | y=h) (x) and z=ho(x) for |x| <6} 


for some 6 > 0, where h, € C"(N6(0)), he € C”(Ng(0)), h, (0) = O, 
h2(0) = 0, Dh,(0) = 0, and Dh2(0) = 0 since W‘°(0) is tangent to the 
center subspace E° = {(x,y,z) € R° x R® x R"® | y = z = 0} at the 
origin. The functions h,(x) and hg(x) can be approximated to any desired 
degree of accuracy (provided that r is sufficiently large) by substituting 
their power series expansions into the following equations: 


Dh, (x)[(Cx+F(x, hy (x), he(x))] — Phi (x) — G(x, hy (x), he(x)) =0 
Dho(x)(Cx+ F(x, hy (x), he(x))] -—Qhe(x) — H(x, hi (x), he(x))=0. (7) 
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Figure 3. The phase portrait for the system in Example 3. 


The next theorem, proved by Carr in [Ca], is analogous to the Hartman- 
Grobman Theorem except that, in order to determine completely the qual- 
itative behavior of the flow near a nonhyperbolic critical point, one must be 
able to determine the qualitative behavior of the flow on the center man- 
ifold, which is determined by the first system of differential equations in 
the following theorem. The nonlinear part of that system, i.e., the function 
F(x, h, (x), ho(x)), can be simplified using the normal form theory in the 
next section. 


Theorem 2. Let E be an open subset of R” containing the origin, and 
let f € C'(E); suppose that £(0) = 0 and that the n x n matrix Df(0) = 
diag(C, P,Q], where the square matriz C has c eigenvalues with zero real 
parts, the square matriz P has s eigenvalues with negative real parts, and 
the square matrix Q has u eigenvalues with positive real parts. Then there 
exists C! functions h,(x) and ho(x) satisfying (7) in a neighborhood of the 
origin such that the nonlinear system (1), which can be written in the form 
(3), is topologically conjugate to the C! system 


x = Cx + F(x, hy (x), ho(x)) 
y = Py 
z= Qz 


for (x,y,z) € R° x R* x R" in a neighborhood of the origin. 
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PROBLEM SET 12 


1. Consider the system in Example 3 in Section 2.7: 


t=2" 


y=-y. 
By substituting the expansion 
h(x) = ax? + br? + --- 
into equation (5) show that the analytic center manifold for this sys- 
tem is defined by the function h(z) = 0 for all x € R; i.e., show that 


the analytic center manifold W‘°(0) = E° for this system. Also, show 
that for each c € R, the function 


0 for zr>0 
h(z,c) = 


W/z for 2 <0 
defines a C™ center manifold for this system, i.e., show that it satisfies 
equation (5). Also, graph h(z,c) for various c € R. 


ce 


2. Use Theorem 1 to determine the qualitative behavior near the non- 
hyperbolic critical point at the origin for the system 
t=y 
y=-ytazr?+zy 
for a # 0 and for a = 0; i.e., follow the procedure in Example 1 after 
diagonalizing the system as in Example 3. 
3. Same thing as in Problem 2 for the system 
r= zy 
y=-y— 2’. 
4. Same thing as in Problem 2 for the system 


t= —2? 


y=-y te’. 
Also, show that this system has no analytic center manifold, i-.e., 
show that if h(x) = ajz? + agzx* + ---, then it follows from (5) that 
Qo = 1, aox%4) = 0 and any = na, for n even; i.e., the Taylor series 
for h(x) diverges for x # 0. 


5. (a) Use Theorem 1 to find the approximation (6) for the flow on the 
local center manifold for the system 
Ly = —Ig+2y 
Lo = 2, + Ty 
y=-y-ap-23+y" 
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and sketch the phase portrait for this system near the origin. 
Hint: Convert the approximation (6) to polar coordinates and 
show that the origin is a stable focus of (6) in the 2), x2 plane. 


(b) Same thing for the system 


° 2 
Zi = 21Y — W179 


to = —2r222 — zi +y? 
y=-ytatt 2}. 
Hint: Show that the approximation (6) has a saddle-node in the 
21,22 plane. 
(c) Same thing for the system 
&, = xfy — x23 
to = —22?22 + y? 
y= —y +2} +23. 
Hint: Show that the approximation (6) has a nonhyperbolic 


critical point at the origin with two hyperbolic sectors in the 
21,22 plane. 


6. Use Theorem 1 to find the approximation (6) for the flow on the local 
center manifold for the system 


£ = az? + bry + cy” 
y= —-y+dz? +exy + fy’, 


and show that if a 4 0, then the origin is a saddle-node. What type of 
critical point is at the origin if a = 0 and bd # 0? What ifa =b=0 
and cd # 0? What if a= d=0? 


7. Use Theorem 1 to find the approximation (6) for the flow on the local 
center manifold for the system 


¢, = —23 - 2? 
. 3 
Iq =21Y — Tp 
See 2 
y=-yt?}. 


What type of critical point is at the origin of this system? 


2.13 Normal Form Theory 


The Hartman-Grobman Theorem shows us that in a neighborhood of a 
hyperbolic critical point, the qualitative behavior of a nonlinear system 


x = f(x) (1) 
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where x € R” is determined by its linear part. In Section 1.8 we saw 
that the linear part of (1) can be put into Jordan canonical form x = Jx, 
which makes it easy to solve the linear system. The Local Center Manifold 
Theorem in the previous section showed us that, in a neighborhood of a 
nonhyperbolic critical point, determining the qualitative behavior of (1) 
could be reduced to the problem of determining the qualitative behavior of 
the nonlinear system 

x = Jx + F(x) (2) 


on the center manifold. Since the dimension of the center manifold is typi- 
cally less than n, this simplifies the problem of determining the qualitative 
behavior of the system (1) near a nonhyperbolic critical point. However, 
analyzing this system still may be a difficult task. The normal form theory 
allows us to simplify the nonlinear part, F(x), of (2) in order to make 
this task as easy as possible. This is accomplished by making a nonlinear, 
analytic transformation of coordinates of the form 


x=y+h(y), (3) 
where h(y) = 0(|y|?) as |y| — 0. Let us illustrate this idea with an example. 
Example 1. The linear part of the system 

2} =I7Q+ az? 
to = 2? +er,;22+ 723; 


is already in Jordan form, and the 2 x 2 matrix 
0 1 
v= 9 


has two zero eigenvalues. In order to reduce this system to the normal form 
used in Theorems 2 and 3 in Section 2.11, we let 


0 
XY \ ay?) 


i.e., we let x; = y, and rq = yo — ay? or, equivalently, yo = x2 + az?. 
Under this nonlinear transformation of coordinates, it is easy to show that 
the above system of differential equations is transformed into the system 


Yi = y2 
Yo = y? + (e + 2a)yrye + (1 — ae)y?. 


The serious student should verify this computation. It then follows from 
Theorem 3 in Section 2.11 that the origin is a cusp for the nonlinear system 
in this example. Note that the qualitative behavior of the system (2) is in- 
variant under the nonlinear change of coordinates (3), which has an inverse 
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in a small neighborhood of the origin since it is a near-identity transforma- 
tion; i.e., the two systems in this example are topologically conjugate, and 
therefore they have the same qualitative behavior in a neighborhood of the 
origin. 


The method of reducing the system (2) to its “normal form” by means of 
a near-identity transformation of coordinates of the form (3) originated in 
the Ph.D. thesis of Poincaré; cf. [28]. The method was used by Andronov 
et al. in their study of planar systems [A-I], and an excellent modern-day 
description of the method can be found in [G/H] or [Wi-II]. If we rewrite 
the system (2) as 

x = Jx + F2(x) + 0(|x|*) 

as |x| — 0, where F2 consists entirely of second-degree terms, then substi- 
tuting the transformation (3) into the above equation and using the Chain 
Rule leads to 


[I + Dh(y)ly = Jy + Jh(y) + Fe(y) + O(ly*}) 
as |y| — 0. And then, since 
[J + Dh(y)|-* = J — Dh(y) + O(ly|”) 
as |y| — 0, it follows that 
y = Jy + Jh(y) — Dh(y)Jy + Fo(y) + O(ly!*) 
= Jy + Fa(y) + 0(lyl*) 
as |y| — 0, where 
F2(y) = Jho(y) — Dho(y)Jy + Fa(y) (4) 


and where we have written h(y) = ho(y) + 0(|y|*) as ly] + 0. We now 
want to choose h(y) in order to make F2(y) as simple as possible. Ideally, 
this would mean choosing h(y) such that F2(y) = 0; however, this is not 
always possible. For example, in the system in Example 1 above, we have 


0 1 ay? 
J=| and Fo(y =( : ). 
0.0 aly) yt + eyiye 


If we let h(y) = ho(y) + 0(|y|*) and substitute the function 


2 2 
A204; + 21141 Y2 + Ao2y2 
ha(y) = ( ; 5 
booy? + biryiye + bo2ys ©) 
into (4), we obtain 
F, (y) = we + (611 — 2a20)yiy2 + (bo2 — _ + ( ay? ) 
—2beoyi ye — b11y2 y; + ey ye 


0 
" (,2 + (e+ —— 
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for the choice of coefficients bg) = —a and a;; = b;; = 0 otherwise in (5). 
As we shall see, this is as “simple” as we can make the quadratic terms in 
the system in Example 1 above. In eu words, if we want to reduce the 
first component of F. to zero, then the y? and the y, yo terms in the second 
component of F(y) cannot be eliminated by a nonlinear pane uuahion of 
coordinates of the form (3). These terms are referred to as “resonance” 
terms; cf. (Wi-I]]. 

In order to get a clearer understanding of what is going on in the above 
example, let us view the function 


Ly{h(y)] = Jh(y) — Dh(y)Jy (6) 


as a linear transformation on the space Ho of all second-degree polynomials 
of the form (5); i.e., in the case of systems in R? we consider Ly as a linear 
operator on the six-dimensional vector space 


to-som{(2).(2).(@)-(2)-)-)} 


We now write x = (z,y)? € R? for ease in notation. A typical element 
he € Hz then is given by 


2 2 
Q20r" + Qi): Ty + Any ) 
h = : 7 

2(z) buat + bi, ry + booy” (7) 


and it is not difficult to compute 


boot? + (b11 — 2a20)ry + (bo2 — @11)y? ). 


Ly{he(x)] = ( —Wboory — by” 


tan sre (4) ()-G)-C)} 
=se0{ (ay):()-(0)-(9)} 


Ho = Ly(H2) ® Go, 


G2 = Span (:2) a | 


This shows that any system of the form 


Thus, 


< 


Thus we see that 


where 


= y+azx? + bry + cy” + 0(|x|%) 
y = dx? + exy + fy? + 0(|x|*) 
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with a general quadratic term F2 € H> can be reduced, by a nonlinear 
transformation of coordinates x — x + ho(x) with he € He given by (7), 
to a system of the form 


z= y + 0(|x|*) 
y = dr? +(e + 2a)ry + 0(|x|9) 


with F2 € Go. In fact, in Problem 1 you will be asked to show that the 
function ho(x), given by (7) with ag2 = a1; = 0, ae9 = (b+ f)/2, bo2 = —c, 
bi; = f, and bg9 = —a, accomplishes this task. 
This process can be generalized as follows: Writing the system (2) in the 
form 
x = Jx + Fo(x) + F3(x) + 0(|x|*) 


as |x| — 0, where F2 € H2 and F3 € Hz, we first can reduce this to a 
system of the form 


x = Jx + Fo(x) + F3(x) + 0(|x|*) 


as |x| — 0 with F2 € G2 and F% € H3 by a nonlinear transformation 
of coordinates (3) with h(x) = ho(x) € H2 as was done above for the 
case when (2) is a system with x € R?. We then can apply the nonlinear 
transformation of coordinates (3) with h(x) = h3(x) € Hg3 to this latter 
system in order to reduce it to a system of the form 


x = Jx + F(x) + F3(x) + 0(|x|*) 


with F; € G3. This is illustrated in Problems 3 and 5. This process then 
can be continued to obtain the so-called “normal form” of the system (2) 
to any desired degree. This is the content of the Normal Form Theorem on 
p. 216 in (Wi-II]. It should be noted that the normal form of the system (2) 
is not unique. This can be seen since, for example, in R?, the linear space of 
polynomials Gz complementary to L,(H2) with the matrix J given in Ex- 
ample 1 is spanned by {(z?,0)7, (0,27)7} as well as by {(0, zy)”, (0, 2?)7}. 


Remark 1. As was shown above (and in Problem 1), any system of the 
form 


x = Jx + F(x) 
with 
2 2 
J = F and F(x) 2 be + bry aa a ae 0(|x|>) 
0 0 dz* +exy+ fy 
as |x| — 0 can be put into the normal form 
z = y + 0(|x|°) 
y = dx? + (e + 2a)xry + 0(|x|) 
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as |x| — 0; furthermore, by letting y — y+0(|x|*), the quantity in the first 
of the above differential equations, this can be reduced to the normal form 
r=y 
y = dx? + (e + 2a)xry + 0(|x|°) 
used in Theorems 2 and 3 in Section 2.11. Then for d # 0 and (e+2a) # 0, it 
follows from Theorems 2 and 3 in Section 2.11 that the 0(|x|*) terms do not 
affect the qualitative nature of the nonhyperbolic critical point at the origin. 
Also they do not affect the types of qualitative dynamical behavior that 
can occur in “unfolding” this nonhyperbolic critical point, as is discussed 
in Chapter 4. Thus, we can delete these terms in studying the bifurcations 
that take place in a neighborhood of this nonhyperbolic critical point and, 
after an appropriate normalization of coordinates, we can use one of the 
following two normal forms for studying these bifurcations: 
r=y 
yor? tcy. 
Cf. Section 4.13, where we also see that all possible types of dynamical 
behavior that can occur in systems “close” to this system are determined 
by the “universal unfoldings” of these two normal forms given by 
r=y 
Y=1i t+ poyta? zy. 

We have almost entirely focused on the case when the linear part J of 
the system (1) is non-zero and has two zero eigenvalues. The case when J 
has two pure imaginary eigenvalues is more complicated, but it is treated 
in Section 3.3 of [G/H] where it is shown that any C° system of the form 

é = -y + O(|x|*) 
y= 2 + O(|x|’) 
can be put into the normal form 


t= —y + (ax — by)(x* + y*) + O(|x|") 
y= a2 + (ay + br)(x* + y*) + O(|x|") 


for suitable constants a and b. Cf. Theorem 2 in Section 4.4. And, as we 
shall see in Problem 1(b) in Section 4.4, the origin is then a stable (or an 
unstable) weak focus of multiplicity 1 if a < 0 (or if a > 0). 


PROBLEM SET 13 
1. Consider the quadratic system 


z= y+ax? + bry + cy? 
y=dzr?+ery+ fy’ 


2.13. 
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with 


0 1 abit 
= f ren en (ae tery + fy?) 
For ho(x) given by (7), compute L y[he(x)], defined by (6), and show 
that for aop2 = a; = 0,a29 = (b+ f)/2,b02 = —c,bi, = f, and 
beg = — 


2 0 
F2(x) = L (he(x)] + F2(x) = & + (e ae ‘dea ; 
Let 
2° xr“y ry y? 
im~srent(9)-(0') Co )-(G): 
0 0 
@hesneone 
0 1 
J=[0 9 
and 
hg(x) = ese! + 2)27y + aygry” + ~) € Ha. 
bspx® + bo r?y + boty? + bosy” 
Show that 
x \ (x?y\ (zy*\ (y° 
bates) = Sean | (_3.2y):(“o") (0 ):(0): 
(4) (v)} 
ay?) \y/ J’ 
and that H3 = Ly(H3) @ G3, where 
0 0 
Gs ~ span (.s):(.24)} 
. Use the results in Problem 2 to show that a planar system of the form 


x = Jx + F3(x) + 0(|x|*) 
with J given in Problem 2 and F3 € H3 can be reduced to the normal 
form 

& = y + 0(|x|*) 

y =ar® + bry + 0(|x|*) 
for some a,b € R. For a # 0, what type of critical point is at the origin 


of this system according to Theorem 2 in Section 2.11? (Consider the 
two cases a > 0 and a < 0 separately.) 
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4. For the 2 x 2 matrix J in Problem 1, show that 


Hg = Ly(Ha) ® Ga, 


G4 = Span { (:) (,) | 


What type of critical point is at the origin of the system 


where 


x = Ix + Fy(x) 


with F, € H, if the second component of F4(x) contains an x4 term? 
Hint: See Theorem 3 in Section 2.11. 


. Show that the quadratic part of the cubic system 


g=yt2?-a+ay’-y* 
y=r*—Qryt+n°-2y 


can be reduced to normal form using the transformation defined in 
Example 1, and show that this yields the system 


L=y- x? + ry’ _ y? + 0(|x|*) 
y =x? + 323 + xy + 0(|x|*) 


as |x| — 0. Then determine a nonlinear transformation of coordinates 
of the form (3) with h(x) = h3(x) € H3 that reduces this system to 
the system 


& = y + 0(|x|*) 
y= x? + 323 - Qx7y + 0(|x|*) 


as |x| — 0, which is said to be in normal form (to degree three). 


Remark 2. As in Remark 1 above, it follows from Theorems 2 and 3 in 
Section 2.11 that the x* and 0(|x|*) terms in the above system of differential 
equations do not affect the nature of the nonhyperbolic critical point at the 
origin. Thus, we might expect that 


r=y 
y= 2*—2Qr*y 


is an appropriate normal form for studying the bifurcations that take place 
in a neighborhood of this nonhyperbolic critical point; however, we see at 
the end of Section 4.13 that the z?y term can also be eliminated and that 
the appropriate normal form for studying these bifurcations is given by 


r=y 
y=r? tory 
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in which case all possible types of dynamical behavior that can occur in 
systems “close” to this system are given by the “universal unfolding” of this 
normal form given by 


r=y 


y =p, + poy + sry + x? + ay. 


2.14 Gradient and Hamiltonian Systems 


In this section we study two interesting types of systems which arise in 
physical problems and from which we draw a wealth of examples of the 
general theory. 


Definition 1. Let E be an open subset of R2” and let H € C?(E) where 
H = H(x,y) with x,y € R”. A system of the form 


(1) 


where 


oH _ (OH aH)” ., OH _ (oH oHY" 
Ox \ Ar," Ory By \dy Ayn)’ 


is called a Hamiltonian system with n degrees of freedom on E. 
For example, the Hamiltonian function 


H(x,y) = (xj +23 + yf + y3)/2 


is the energy function for the spherical pendulum 


ty = 4 
Z2 = y2 
y= TZ) 
yo = —Z2 


which is discussed in Section 3.6 of Chapter 3. This system is equivalent to 
the pair of uncoupled harmonic oscillators 


Z, +2, =0 
Lo+22=0. 
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All Hamiltonian systems are conservative in the sense that the Hamiltonian 
function or the total energy H(x, y) remains constant along trajectories of 
the system. 


Theorem 1 (Conservation of Energy).The total energy H(x,y) of 
the Hamiltonian system (1) remains constant along trajectories of (1). 


Proof. The total derivative of the Hamiltonian function H(x,y) along a 
trajectory x(t), y(t) of (1) 


dH OH . OH . OH OH OH OH 
K+ ——- y=. - — -— = 0. 


‘dt Ox oy ax Oy Oy Ox 
Thus, H(x, y) is constant along any solution curve of (1) and the trajecto- 
ries of (1) lie on the surfaces H(x, y) = constant. 


We next establish some very specific results about the nature of the 
critical points of Hamiltonian systems with one degree of freedom. Note 
that the equilibrium points or critical points of the system (1) conespone 
es the critical points of the Hamiltonian function H(x,y) where 2 ou = 
ay = 0. We may, without loss of generality, assume that the critical point 
in question has been translated to the origin. 


Lemma. [If the origin is a focus of the Hamiltonian system 
= H,(z, y) 
y = —H,(z, y); (1’) 


then the origin is not a strict local maximum or minimum of the Hamilto- 
nian function H(z, y). 


Proof. Suppose that the origin is a stable focus for (1’). Then according 
to Definition 3 in Section 2.10, there is an €¢ > 0 such that for 0 < ro < € 
and 0) € R, the polar coordinates of the solution of (1') with r(0) = ro 
and 6(0) = % satisfy r(t,ro,40) — 0 and |@(t,ro,40)| —- co as t — 00; 
ie., for (20, yo) € N-(O) ~ {0}, the solution (z(t, zo, yo), y(t, Zo, yo)) — 0 
as t — oo. Thus, by Theorem 1 and the continuity of H(z,y) and the 
solution, it follows that 


H(Z0, yo) = jim H (z(t, Zo, yo), y(t, Zo, Yo)) = A(0, 0) 


for all (zo, yo) € N_-(0). Thus, the origin is not a strict local maximum or 
minimum of the function H(z, y); i.e., it is not true that H(z, y) > H(0,0) 
or H(z,y) < H(0,0) for all points (z,y) in a deleted neighborhood of the 
origin. A similar argument applies when the origin is an unstable focus 
of (1’). 
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Definition 2. A critical point of the system 
x = f(x) 


at which Df(xo) has no zero eigenvalues is called a nondegenerate critical 
point of the system, otherwise, it is called a degenerate critical point of the 
system. 


Note that any nondegenerate critical point of a planar system is either a 
hyperbolic critical point of the system or a center of the linearized system. 


Theorem 2. Any nondegenerate critical point of an analytic Hamiltonian 
system (1') is either a (topological) saddle or a center; furthermore, (Zo, yo) 
is a (topological) saddle for (1') iff it is a saddle of the Hamiltonian function 
H(z, y) and a strict local maximum or minimum of the function H(z, y) is 
a center for (1’). 


Proof. We assume that the critical point is at the origin. Thus, H,(0,0) = 
H, (0,0) = 0 and the linearization of (1’) at the origin is 


x = Ax (2) 
where 
Re Hyz(0, 0) Hy, (0, 0 . 
~Ligg (0, 0) ~~ 42 zy (0, 0) 


We see that tr A = 0 and that detA = H;,(0)H,,(0) — H?,,(0). Thus, the 
critical point at the origin is a saddle of the function H(z, y) iff det A <0 
iff it is a saddle for the linear system (2) iff it is a (topological) saddle 
for the Hamiltonian system (1') according to Theorem 3 in Section 2.10. 
Also, according to Theorem 1 in Section 1.5 of Chapter 1, if trA = 0 
and det A > 0, the origin is a center for the linear system (2). And then 
according to the Corollary in Section 2.10, the origin is either a center or 
a focus for (1'). Thus, if the nondegenerate critical point (0,0) is a strict 
local maximum or minimum of the function H(z, y), then det A > 0 and, 
according to the above lemma, the origin is not a focus for (1'); i.e., the 
origin is a center for the Hamiltonian system (1’). 

One particular type of Hamiltonian system with one degree of freedom 
is the Newtonian system with one degree of freedom, 


# = f(x) 


where f € C'(a,b). This differential equation can be written as a system 
in R?: 
r=y 


§ = f(2). (3) 
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The total energy for this system H(z, y) = T(y) +U(zx) where T(y) = y?/2 
is the kinetic energy and 


U(x) = -[ f(s)ds 


is the potential energy. With this definition of H(z,y) we see that the 
Newtonian system (3) can be written as a Hamiltonian system. It is not 
difficult to establish the following facts for the Newtonian system (2); cf. 
Problem 9 at the end of this section. 


Theorem 3. The critical points of the Newtonian system (3) all lie on the 
x-axis. The point (xo,0) is a critical point of the Newtonian system (3) iff 
it 1s a critical point of the function U(zx), i.e., a zero of the function f(z). 
If (9,0) is a strict local marimum of the analytic function U(z), it is a 
saddle for (3). If (29,0) is a strict local minimum of the analytic function 
U(x), it is a center for (3). If (x0,0) is a horizontal inflection point of 
the function U(x), it is a cusp for the system (3). And finally, the phase 
portrait of (3) is symmetric with respect to the x-azis. 


Example 1. Let us construct the phase portrait for the undamped pen- 
dulum 


Z+sinz=0. 
This differential equation can be written as a Newtonian system 


rI=y 


y= —sin x 


where the potential energy 
z 
U(r) = [ sin tdt = 1—cos Zz. 
0 


The graph of the function U(z) and the phase portrait for the undamped 
pendulum, which follows from Theorem 3, are shown in Figure 1 below. 

Note that the origin in the phase portrait for the undamped pendulum 
shown in Figure 1 corresponds to the stable equilibrium position of the 
pendulum hanging straight down. The critical points at (+7,0) correspond 
to the unstable equilibrium position where the pendulum is straight up. 
Trajectories near the origin are nearly circles and are approximated by the 
solution curves of the linear pendulum 


eta = 0; 
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U 


< 


PAWL 


Figure 1. The phase portrait for the undamped pendulum. 


The closed trajectories encircling the origin describe the usual periodic 
motions associated with a pendulum where the pendulum swings back and 
forth. The separatrices connecting the saddles at (+7,0) correspond to 
motions with total energy H = 2 in which case the pendulum approaches 
the unstable vertical position as t — -too. And the trajectories outside the 
separatrix loops, where H > 2, correspond to motions where the pendulum 
goes over the top. 
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Definition 3. Let E be an open subset of R” and let V € C?(E). A 
system of the form 


< = —grad V(x), (4) 
where Zo 
OV OV 
gedv = (5... 5°] ; 


is called a gradient system on E. 

Note that the equilibrium points or critical points of the gradient system 
(4) correspond to the critical points of the function V(x) where grad V(x) = 
0. Points where grad V(x) # 0 are called regular points of the function 
V(x). At regular points of V(x), the gradient vector gradV(x) is perpen- 
dicular to the level surface V(x) = constant through the point. And it is 
easy to show that at a critical point x9 of V(x), which is a strict local 
minimum of V(x), the function V(x) — V(x9) is a strict Liapunov function 
for the system (4) in some neighborhood of x9; cf. Problem 7 at the end of 
this section. We therefore have the following theorem: 


Theorem 4. At regular points of the function V(x), trajectories of the 
gradient system (4) cross the level surfaces V(x) = constant orthogonally. 
And strict local minima of the function V(x) are asymptotically stable equi- 
librium points of (4). 


Since the linearization of (4) at any critical point xo of (4) has a matrix 


8°V (x0) 
A= |—— 
Oz,02; 2,j7=1,....n 


which is symmetric, the eigenvalues of A are all real and A is diagonalizable 
with respect to an orthonormal basis; cf. [H/S]. 

Once again, for planar gradient systems, we can be very specific about 
the nature of the critical points of the system: 


Theorem 5. Any nondegenerate critical point of an analytic gradient sys- 
tem (4) on R? is either a saddle or a node; furthermore, if (x0, yo) is a 
saddle of the function V(z, y), it is a saddle of (4) and if (zo, yo) is a strict 
local mazimum or minimum of the function V(z, y), it is respectively an 
unstable or a stable node for (4). 


Example 2. Let V(z, y) = 27(z — 1)? + y*. The gradient system (4) then 
has the form 


z= —42z(zx — 1)(z — 1/2) 
y = —2y. 


There are critical points at (0,0), (1/2,0) and (1,0). It follows from The- 
orem 5 that (0,0) and (1,0) are stable nodes and that (1/2,0) is a saddle 
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for this system; cf. Problem 8 at the end of this section. The level curves 
V(z,y) = constant and the trajectories of this system are shown in Fig- 
ure 2. 


CCE a 


lye “a 
4] \ 


jee LS 
VV LTT 
A | 


Figure 2. The level curves V(z,y) = constant (closed curves) and the 
trajectories of the gradient system in Example 2. 


One last topic, which shows that there is an interesting relationship be- 
tween gradient and Hamiltonian systems, is considered in this section. We 
only give the details for planar systems. 


Definition 4. Consider the planar system 
t= P(z,y) 
5 
y = Q(z, y). ©) 
The system orthogonal to (5) is defined as the system 


z= Q(z, y) 


j= -P(2,y). u 
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Clearly, (5) and (6) have the same critical points and at regular points, 
trajectories of (5) are orthogonal to the trajectories of (6). Furthermore, 
centers of (5) correspond to nodes of (6), saddles of (5) correspond to 
saddles of (6), and foci of (5) correspond to foci of (6). Also, if (5) is a 
Hamiltonian system with P = H, and Q = —H,, then (6) is a gradient 
system and conversely. 


Theorem 6. The system (5) is a Hamiltonian system iff the system (6) 
orthogonal to (5) is a gradient system. 


In higher dimensions, we have that if (1) is a Hamiltonian system with 
n degrees of freedom then the system 


oH 

Ox 
oH (7) 

VS 


orthogonal to (1) is a gradient system in R2” and the trajectories of the 
gradient system (7) cross the surfaces H(x,y) = constant orthogonally. 
In Example 2 if we take H(z,y) = V(z,y), then Figure 2 illustrates the 
orthogonality of the trajectories of the Hamiltonian and gradient flows, the 
Hamiltonian flow swirling clockwise. 


PROBLEM SET 14 


1. (a) Show that the system 


Z=ayjr+aoy+ Az? — 2Bry + Cy? 
y = a9, 2 — ayy + Dz? — 2Ary + By’ 


is a Hamiltonian system with one degree of freedom; i.e., find 
the Hamiltonian function H(z, y) for this system. 


(b) Given f € C!(E), where E is an open, simply connected subset 
of R?, show that the system 


x = f(x) 
is a Hamiltonian system on E iff V - f(x) = 0 for all x € E. 
2. Find the Hamiltonian function for the system 


r=y 
y= —zr+2? 


and, using Theorem 3, sketch the phase portrait for this system. 
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3. Same as Problem 2 for the system 
r=y 


y=—r+c°. 


4, Given the function U(x) pictured below: 


U 


O 


sketch the phase portrait for the Hamiltonian system with Hamilto- 
nian H(z, y) = y?/2+U(z). 


5. For each of the following Hamiltonian functions, sketch the phase 
portraits for the Hamiltonian system (1) and the gradient system 
(7) orthogonal to (1). Draw both phase portraits on the same phase 
plane. 

(a) H(z,y) = 2? + 2y” 

(b) H(z,y) = 2? —y? 

(c) H(z,y) = ysinz 

(d) A(z,y) = 2? —y? —2r+ 4y4+5 

(e) H(z, y) = 2x? — Qry + 5y? + 42+ 4y +4 
(f) H(z, y) = x? — Qry — y* + 2x — 2y +2. 

6. For the gradient system (4), with V(z, y, z) given below, sketch some 
of the surfaces V(z, y, z) = constant and some of the trajectories of 
the system. 

(a) V(x,y,z) =a? +y? -2 
(b) V(z,y,z) = 2° + 2y* +z? 
(c) V(z,y,z) = 2°(z — 1) + y*(y — 2) + 2”. 
7. Show that if xo is a strict local minimum of V(x) then the function 


V(x) — V(xo) is a strict Liapunov function for the gradient system 
(4). 
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10. 


11. 


12. 
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. Show that the function V(z,y) = z?(z — 1)? + y? has strict local 


minima at (0,0) and (1,0) and a saddle at (1/2,0), and therefore that 
the gradient system (4) with V(z, y) given above has stable nodes at 
(0,0) and (1,0) and a saddle at (1/2,0). 


. Prove that the critical point (z9,0) of the Newtonian system (3) is a 


saddle if it is a strict local maximum of the function U(z) and that it 
is a center if it is a strict local minimum of the function U(z). Also, 
show that if (zo,0) is a horizontal inflection point of U(z) then it is 
a cusp of the system (3); cf. Figure 4 in Section 2.11. 


Prove that if the system (5) has a nondegenerate critical point at the 
origin which is a stable focus with the flow swirling counterclockwise 
around the origin, then the system (6) orthogonal to (5) has an unsta- 
ble focus at the origin with the flow swirling counterclockwise around 
the origin. Hint: In this case, the system (5) is linearly equivalent to 


x = ax — by + higher degree terms 
y = br + ay + higher degree terms 


with a < 0 and 6 > 0. What does this tell you about the system (6) 
orthogonal to (5)? Consider other variations on this theme; e.g., what 
if the origin has an unstable clockwise focus? 


Show that the planar two-body problem 


= x 
7. © (x2 + y2)3/2 

pons 2 

y= (x2 + y2)3/2 


can be written as a Hamiltonian system with two degrees of freedom 
on E = R‘ ~ {0}. What is the gradient system orthogonal to this 
system? 


Show that the flow defined by a Hamiltonian system with one-degree 
of freedom is area preserving. Hint: Cf. Problem 6 in Section 2.3. 


3 


Nonlinear Systems: Global 
Theory 


In Chapter 2 we saw that any nonlinear system 
x = f(x), (1) 


with f € C'(E) and E an open subset of R”, has a unique solution ¢, (xo), 
passing through a point x9 € E at time t = 0 which is defined for all t € 
I(x), the maximal interval of existence of the solution. Furthermore, the 
flow @, of the system satisfies (i) @g(x) = x and (ii) $.4,,(x) = $,(%,(x)) 
for all x € E and the function $(t, x) = @,(x) defines a C!-map @: 2 > E 
where 2 = {(t,x) € Rx E|t € I(x)}. 

In this chapter we define a dynamical system as a C!-map @: Rx E — E 
which satisfies (i) and (ii) above. We first show that we can rescale the 
time in any C}-system (1) so that for all x € E, the maximal interval of 
existence I(x) = (—00,00). Thus any C!-system (1), after an appropriate 
rescaling of the time, defines a dynamical system @: R x E — E where 
(t,x) = ,(x) is the solution of (1) with @)(x) = x. We next consider limit 
sets and attractors of dynamical systems. Besides equilibrium points and 
periodic orbits, a dynamical system can have homoclinic loops or separatrix 
cycles as well as strange attractors as limit sets. We study periodic orbits 
in some detail and give the Stable Manifold Theorem for periodic orbits as 
well as several examples which illustrate the general theory in this chapter. 
Determining the nature of limit sets of nonlinear systems (1) with n > 3 is 
a challenging problem which is the subject of much mathematical research 
at this time. 

The last part of this chapter is restricted to planar systems where the 
theory is more complete. The Poincaré-Bendixson Theorem, established in 
Section 3.7, implies that for planar systems any w-limit set is either a critical 
point, a limit cycle or a union of separatrix cycles. Determining the number 
of limit cycles of polynomial systems in R? is another difficult problem in 
the theory. This problem was posed in 1900 by David Hilbert as one of 
the problems in his famous list of outstanding mathematical problems at 
the turn of the century. This problem remains unsolved today even for 
quadratic systems in R*. Some results on the number of limit cycles of 
planar systems are established in Section 3.8 of this chapter. We conclude 
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this chapter with a technique, based on the Poincaré-Bendixson Theorem 
and some projective geometry, for constructing the global phase portrait 
for a planar dynamical system. The global phase portrait determines the 
qualitative behavior of every solution @,(x) of the system (1) for all t € 
(—00, 00) as well as for all x € R?. This qualitative information combined 
with the quantitative information about individual trajectories that can be 
obtained on a computer is generally as close as we can come to solving a 
nonlinear system of differential equations; but, in a sense, this information 
is better than obtaining a formula for the solution since it geometrically 
describes the behavior of every solution for all time. 


3.1 Dynamical Systems and Global Existence 
Theorems 


A dynamical system gives a functional description of the solution of a 
physical problem or of the mathematical model describing the physical 
problem. For example, the motion of the undamped pendulum discussed in 
Section 2.14 of Chapter 2 is a dynamical system in the sense that the motion 
of the pendulum is described by its position and velocity as functions of 
time and the initial conditions. 

Mathematically speaking, a dynamical system is a function $(t, x), de- 
fined for allt € Randx € E Cc R", which describes how points x € E move 
with respect to time. We require that the family of maps @,(x) = $(t, x) 
have the properties of a flow defined in Section 2.5 of Chapter 2. 


Definition 1. A dynamical system on E is a C!-map 
@ Rx E-E 
where £ is an open subset of R” and if $,(x) = $(t,x), then @, satisfies 
(i) @o(x) =x for all x € E and 
(ii) 6, ° (x) = $:4,(x) for all s,t€ R andxe E. 


Remark 1. It follows from Definition 1 that for each t € R, ¢, is a C’- 
map of E into E which has a C’-inverse, @_,; i.e., @, with t € R is a 
one-parameter family of diffeomorphisms on E£ that forms a commutative 
group under composition. 

It is easy to see that if A is an n x n matrix then the function (t,x) = 
e4Atx defines a dynamical system on R” and also, for each xp € R”, $(t, xo) 
is the solution of the initial value problem 


x = Ax 
x(0) = Xo. 
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In general, if @(t, x) is a dynamical system on E C R”, then the function 


f(x) = < ott X)|e=o 


defines a C!-vector field on E and for each xo € E, $(t, Xo) is the solution 
of the initial value problem 


x = f(x) 
x(0) = Xo. 


Furthermore, for each x9 € E, the maximal interval of existence of @(t, xo), 
I(x) = (—00, 00). Thus, each dynamical system gives rise to a C!-vector 
field f and the dynamical system describes the solution set of the differ- 
ential equation defined by this vector field. Conversely, given a differential 
equation (1) with f € C!(E) and E an open subset of R”, the solution 
o(t, Xo) of the initial value problem (1) with xo € E will be a dynamical 
system on E if and only if for all xo € E, @(t, xo) is defined for all t € R; 
i.e., if and only if for all x9 € E, the maximal interval of existence I(x) 
of @(t,xo) is (—co, co). In this case we say that (t,x) is the dynamical 
system on E defined by (1). 

The next theorem shows that any C!-vector field f defined on all of 
R” leads to a dynamical system on R”. While the solutions $(t, xo) of 
the original system (1) may not be defined for all ¢ € R, the time ¢ can 
be rescaled along trajectories of (1) to obtain a topologically equivalent 
system for which the solutions are defined for all t € R. 

Before stating this theorem, we generalize the notion of topological equiv- 
alent systems defined in Section 2.8 of Chapter 2 for a neighborhood of the 
origin. 


Definition 2. Suppose that f € C!(E,) and g € C!(E2) where FE, and E2 
are open subsets of R”. Then the two autonomous systems of differential 
equations 

x = f(x) (1) 
and 

x = g(x) (2) 
are said to be topologically equivalent if there is a homeomorphism H: E,-® 
E» which maps trajectories of (1) onto trajectories of (2) and preserves their 
orientation by time. In this case, the vector fields f and g are also said to 
be topologically equivalent. If E = E, = E, then the systems (1) and (2) 
are said to be topologically equivalent on E and the vector fields f and g 
are said to be topologically equivalent on E. 


Remark 2. Note that while the homeomorphism H in this definition pre- 
serves the orientation of trajectory by time and gives us a continuous de- 
formation of the phase portrait of (1) in the phase space FE, onto the phase 
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portrait of (2) in the phase space E2, it need not preserve the parameteri- 
zation by time along the trajectories. In fact, if @, is the flow on EF, defined 
by (1) and we assume that (2) defines a dynamical system 7, on E2, then 
the systems (1) and (2) are topologically equivalent if and only if there is a 
homeomorphism H: E£) 8 E2 and for each x € E| there is a continuously 
differentiable function t(x,7) defined for all 7 € R such that O0t/O7 > 0 
and 


H 0 de(xn)(X) = Br 0H (x) 


for all x € E, and 7 € R. In general, two autonomous systems are topolog- 
ically equivalent on E if and only if they are both topologically equivalent 
to some autonomous system of differential equations defining a dynamical 
system on E£ (cf. Theorem 2 below). As was noted in the above definitions, 
if the two systems (1) and (2) are topologically equivalent, then the vector 
fields f and g are said to be topologically equivalent; on the other hand, if 
the homeomorphism H does preserve the parameterization by time, then 
the vector fields f and g are said to be topologically conjugate. Clearly, if 
two vector fields f and g are topologically conjugate, then they are topo- 
logically equivalent. 


Theorem 1 (Global Existence Theorem). For f € C!(R") and for 
each Xo € R", the initial value problem 

._ _ f(x) 

*= T+ IFO] 


x(0) = xo (3) 


has a unique solution x(t) defined for allt € R, 1.e., (3) defines a dynamical 
system on R"; furthermore, (3) is topologically equivalent to (1) on R”. 


Remark 3. The systems (1) and (3) are topologically equivalent on R” 
since the time t along the solutions x(t) of (1) has simply been rescaled 
according to the formula 


t 
r= f [1+ letx(s))M as (4) 
i.e., the homeomorphism H in Definition 2 is simply the identity on R”. 


The solution x(t) of (1), with respect to the new time 7, then satisfies 


de _ dxdt fe) 
dr dt’ dt 1+/{|f(x)|’ 


i.e., x(t(7T)) is the solution of (3) where ¢(7) is the inverse of the strictly 
increasing function 7(t) defined by (4). The function 7(¢) maps the maximal 


3.1. Dynamical Systems and Global Existence Theorems 185 


interval of existence (a, @) of the solution x(t) of (1) one-to-one and onto 
(—0o, 00), the maximal interval of existence of (3). 


Proof (of Theorem 1). It is not difficult to show that if f € C!(R”) then 
the function 


f 
Cc} R" 
TE iota 
cf. Problem 3 at the end of this section. For x9 € R”, let x(t) be the solution 
of the initial value problem (3) on its maximal interval of existence (a, @). 
Then by Problem 6 in Section 2.2, x(t) satisfies the integral equation 


eT CO) 
x)=x0+ | een 


for all t € (a, 3) and since |f(x)|/(1 + |f(x)|) < 1, it follows that 


|e] 
Px(@) < bxol + [ds = bxol +E 
for all t € (a, 8). Suppose that B < oo. Then 


|x(t)| < |xol + 8 


for all ¢ € (0, G); i-e., for all t € (0, 8), the solution of (3) through the point 
Xo at time ¢ = 0 is contained in the compact set 


K = {x € R” | |x| < |xo| + 8} Cc R”. 


But then, by Corollary 2 in Section 2.4 of Chapter 2, @ = oo, a contradic- 
tion. Therefore, 6 = oo. A similar proof shows that a = —oo. Thus, for 
all x9 € R”, the maximal interval of existence of the solution x(t) of the 
initial value problem (3), (a, @) = (—00, 00). 


Example 1. As in Problem 1(a) in Problem Set 4 of Chapter 2, the max- 
imal interval of existence of the solution 


ro 
t)= 
att) 1 — Zot 
of the initial value problem 
<= 2" 
x(0) = 29 


is (—oo, 1/29) for zo > 0, (1/20, 00) for ro < 0 and (—00, 00) for zp = 0. 
The phase portrait in R! is simply 


—__—_—_»>—___+—___+»>—__—-¢ 
0 
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The related initial value problem 
~ 142? 
z(0) = zo 


has a unique solution z(t) defined on (—0o, 00) which is given by 


1 1 1\? 
Qa(t) =t+25-—+— t2?+2( 29 -— ]t+[ 29+ — 
Io {Zo Zo Zo 
for Zo # 0 and z(t) =0 for zo = 0. It follows that for xo > 0, z(t) — 00 as 
t — oo and z(t) — 0 as t — —oo; and for zo < 0, z(t) — 0 as t > 00 and 
x(t) -+ —0co as t — —oo. The phase portrait for the second system above is 
exactly the same as the phase portrait for the first system. In this example, 
the function 7(t) defined by (4) is given by 


ret 


r(t) =t+ = 


For ro = 0, T(t) = t; for zo > 0, 7(t) maps the maximal interval (—oo, 1/z9) 
one-to-one and onto (—0o,00); and for zo < 0, 7(t) maps the maximal 
interval (1/2 9,00) one-to-one and onto (—00, 00). 

If f € C'(£) with E a proper subset of R”, the above normalization will 
not, in general, lead to a dynamical system as the next example shows. 


Example 2. For zo > 0 the initial value problem 


eect 
~ Qa 
z(0) = 29 


has the unique solution z(t) = /t + 22 defined on its maximal interval of 
bere I(zo) = (—2§, 00). The function f (x), = 1/(2r) € C'(E) where 

= (0,00). We have z(t) + 0 € E as t > —22. The related initial value 
se 


_ Afae _ 1 
~ 14(1/2z2) 2241 
z(0) = 20 


has the unique solution 
1 
a(t) = -5 + Vt + (zo + 1/2)? 


defined on its maximal interval of existence I(zo) = (—(zo + 1/2)”, 00). We 
see that in this case I(zo) # R. 
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However, a slightly more subtle rescaling of the time along trajectories 
of (1) does lead to a dynamical system equivalent to (1) even when E is a 
proper subset of R”. This idea is due to Vinograd; cf. (N/S]. 


Theorem 2. Suppose that E is an open subset of R” and that f € C'(E). 
Then there is a function F € C'(E) such that 


x = F(x) (5) 


defines a dynamical system on E and such that (5) ts topologically equiva- 
lent to (1) on E. 


Proof. First of all, as in Theorem 1, the function 


f(x) 


g(x) = T+ IFOol € C'(E), 


|\g(x)| < 1 and the systems (1) and (3) are topologically equivalent on E. 
Furthermore, solutions x(t) of (3) satisfy 


t t 
‘ Lx(t!)| dt" = | le(x(t’))| dt’ < |} 
0 0 


i.e., for finite t, the trajectory defined by x(t) has finite arc length. Let (a, @) 
be the maximal interval of existence of x(t) and suppose that B < oo. Then 
since the arc length of the half-trajectory defined by x(t) for t € (0, 8) is 
finite, the half-trajectory defined by x(t) for t € [0,@) must have a limit 
point 

XxX} = ce x(t)e E 


(unlike Example 3 in Section 2.4 of Chapter 2). Cf. Corollary 1 and Prob- 
lem 3 in Section 2.4 of Chapter 2. Now define the closed set K = RR" ~ E 
and let 

d(x, K) 
1 + d(x, K) 


where d(x, y) denotes the distance between x and y in R” and 


G(x) = 


d(x, K) = inf d(x, y); 


i.e., for x € E, d(x, K) is the distance of x from the boundary E of E. 
Then the function G € C!(R"), 0 < G(x) < 1 and for x € K, G(x) = 0. 
Let F(x) = g(x)G(x). Then F € C'(E) and the system (5), x = F(x), 
is topologically equivalent to (3) on E since we have simply rescaled the 
time along trajectories of (3); i.e., the homeomorphism H in Definition 2 
is simply the identity on E. Furthermore, the system (5) has a bounded 
right-hand side and therefore its trajectories have finite arc-length for finite 
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t. To prove that (5) defines a dynamical system on E, it suffices to show 
that all half-trajectories of (5) which (a) start in E, (b) have finite arc 
length so, and (c) terminate at a limit point x, € E are defined for all 
t € [0, 00). Along any solution x(t) of (5), de = |z(t)| and hence 


8 ds’ 
t= | IF (x(t(s")) 


where ¢(s) is the inverse of the strictly increasing function s(t) defined by 


ox f “[F(x(e’))|de! 


for s > 0. But for each point x = x(t(s)) on the half-trajectory we have 


d(x, K) 
1+ d(x, K) 


And therefore since 0 < |g(x)| < 1, we have 


§ ds’ 89 — 8 
0 S0-8 S80 


and hence t — 00 as s — 39; i.e., the half-trajectory defined by x(t) is 
defined for all t € (0,00); ie., 8 = oo. Similarly, it can be shown that 
a = —oo and hence, the system (5) defines a dynamical system on E which 
is topologically equivalent to (1) on E. 

For f € C!(E), E an open subset of R", Theorem 2 implies that there is 
no loss in generality in assuming that the system (1) defines a dynamical 
system $(t, Xo) on E. Throughout the remainder of this book we therefore 
make this assumption; i.e., we assume that for all x9 € E, the maximal 
interval of existence J(x9) = (—00, 00). In the next section, we then go on 
to discuss the limit sets of trajectories x(t) of (1) as t + too. However, we 
first present two more global existence theorems which are of some interest. 


Theorem 3. Suppose that f € C!(R") and that f(x) satisfies the global 
Lipschitz condition 


G(x) = < d(x, K) = inf d(x, y) S d(x, x1) < 80 — 8. 


lf(x)| - f(y)| < M|x-y| 
for allx,y € R®. Then for xo € R", the initial value problem (1) has a 
unique solution x(t) defined for allt € R. 


Proof. Let x(t) be the solution of the initial value problem (1) on its 
maximal interval of existence (a, 3). Then using the fact that d|x(t)|/dt < 
|x(t)| and the triangle inequality, 


£ |x(t) — xo] < b(t] = [eCx(¢)) 
< |f(x(¢)) — £(xo)| + |f(xo)| 
< M|x(t) — xo| + |f(xo)]. 
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Thus, if we assume that 6 < oo, then the function g(t) = |x(t) —xo| satisfies 


s 


t t 
g(t) = i OMS) as < |f(x0)|8 + M i g(s) de 


for all t € (0, 8). It then follows from Gronwall’s Lemma in Section 2.3 of 
Chapter 2 that 

Ix(t) — Xo] < BIF(x0)|e”? 
for all t € (0, G); i-e., the trajectory of (1) through the point xo at time 
t = 0 is contained in the compact set 


K = {x € R" | |x — xo] < BIF(x0)|e”*} Cc R”. 


But then by Corollary 2 in Section 2.4 of Chapter 2, it follows that G = oo, 
a contradiction. Therefore, G = oo and it can similarly be shown that 
a = —oo. Thus, for all xo € R”, the maximal interval of existence of the 
solution x(t) of the initial value problem (1), [(xo) = (—00, 00). 

If f € C'(M) where M is a compact subset of R", then f satisfies a 
global Lipschitz condition on M and we have a result similar to the above 
theorem for Xo € M. This result has been extended to compact manifolds 
by Chillingworth; cf. [G/H], p. 7. A C!-vector field on a manifold M is 
defined at the end of Section 3.10. 


Theorem 4 (Chillingworth). Let M be a compact manifold and let 
f € C'(M). Then for xo € M, the initial value problem (1) has a unique 
solution x(t) defined for allt € R. 


PROBLEM SET 1 


1. If f(x) = Ax with 
-1 -3 
a-[o | 
find the dynamical system defined by the initial value problem (1). 


2. If f(x) = x?, find the dynamical system defined by the initial value 
problem (3), and show that it agrees with the result in Example 1. 


3. (a) Show that if E is an open subset of R and f € C}(E) then the 
function 


f(x) 
Me) = Tel 


satisfies F € C!(E). 
Hint: Show that if f(z) 40 at x € E then 


Vo #2) 
F@ = (Tre? 
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and that if for ro € E, f(zo0) = 0 then F’ (zo) = f’(zo) and that 
limz—25 F'(z) = F’ (zo). 


(b) Extend the results of part (a) to f € C!(E) for E an open subset 
of R”. 


4. Show that the function 


a. 
1+ 2? 


f(z) = 


satisfies a global Lipschitz condition on R and find the dynamical 
system defined by the initial value problem (1) for this function. 


. Another way to rescale the time along trajectories of (1) is to define 


t 
r= [1 +I8(x(s)P}as 
0 
This leads to the initial value problem 
_ __ f(x) 
~ 14 |f(x)|? 


for the function x(t(r)). Prove a result analogous to Theorem 1 for 
this system. 


x 


. Two vector fields f,g € C*(R”) are said to be C*-equivalent on R” 


if there is a homeomorphism H of R” with H, H—! € C*(R”) which 
maps trajectories of (1) onto trajectories of (2) and preserves their 
orientation by time; H is called a C*-diffeomorphism on R”. If @, and 
a, are dynamical systems on R” defined by (1) and (2) respectively, 
then f and g are C*-equivalent on R” if and only if there exists a 
C*-diffeomorphism on R” and for each x € R” there exists a strictly 
increasing C*-function 7(x, ¢) such that 07/Ot > 0 and 


H 0 $,(x) = Be(x,1) 0 A(x) (*) 
for all z € R" andt ER. If f and g are C!-equivalent on R”, 


(a) prove that equilibrium points of (1) are mapped to equilibrium 
points of (2) under H and 


(b) prove that periodic orbits of (1) are mapped onto periodic orbits 
of (2) and that if to is the period of a periodic orbit @,(xo9) of (1) 
then 7 = 7(Xo, to) is the period of the periodic orbit »,(H(xo)) 
of (2). 


Hint: In order to prove (a), differentiate (*) with respect to ¢, using 
the chain rule, and show that if f(xo) = O then g(2,(H(xo))) = 0 
for all r € R; i.e., ,(H(xo)) = H(xo) for all 7 € R. 
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7. If f and g are C? equivalent on R”, prove that at an equilibrium point 
Xo of (1), the eigenvalues of Df(x9) and the eigenvalues of Dg(H (xo)) 
differ by the positive multiplicative constant ko = ST (xo, 0). 


Hint: Differentiate (+) twice, first with respect to t and then, after 
setting ¢ = 0, with respect to x and then show that Df(xo) and 
kp Dg(.H(xo)) are similar. 


8. Two vector fields, f,g € C*(R”) are said to be C*-conjugate on R” 
if there is a C*-diffeomorphism of R" which maps trajectories of (1) 
onto trajectories of (2) and preserves the parameterization by time. 
If @, and wp, are the dynamical systems on R” defined by (1) and 
(2) respectively, then f and g are C*-conjugate on R” if and only if 
there exists a C;,-diffeomorphism H such that 


Ho¢d,=%,0H 


on R”. Prove that if f and g are C?-conjugate on R® then at an 
equilibrium point x9 of (1), the eigenvalues of Df(xo) and Dg(H(xo)) 
are equal. 


9. (Discrete Dynamical Systems). If d, is a dynamical system on an open 
set E C R", then the mapping F: E — E defined by F(x) = $,(x), 
where 7 is any fixed time in R, is a diffeomorphism on E which 
defines a discrete dynamical system. The discrete dynamical system 
consists of the iterates of F; i.e., for each x € E we get a sequence 
of points F(x), F?(x), F3(x),..., in E. Iterates of the Poincaré map 
P, discussed in Section 3.4, also define a discrete dynamical system. 
In fact, any map F: E — E which is a diffeomorphism on E defines 
a discrete dynamical system {F"}, n = 0,+1,+2,..., on E. In this 
context, show that for » # 0 the mapping F(z, y) = (y, uzrt+y—y") is 
a diffeomorphism and find its inverse. For 4 > 0 show that (,/7, 2) 


is a fixed point of F; i.e., show that F(/u, /z) = (Vp, Vp). 


3.2 Limit Sets and Attractors 


Consider the autonomous system 

x = f(x) (1) 
with f € C'(E) where E is an open subset of R®. In Section 3.1 we saw 
that there is no loss in generality in assuming that the system (1) defines 
a dynamical system (t,x) on E. For x € E, the function $(-,x): R- E 
defines a solution curve, trajectory, or orbit of (1) through the point xo 


in E. If we identify the function ¢(-,x) with its graph, we can think of a 
trajectory through the point x9 € E as a motion along the curve 


Vxo = {x € E| x = P(t, xo), t € R} 
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defined by (1). We shall also refer to T,, as the trajectory of (1) through 
the point xo at time ¢ = 0. If the point xq plays no role in the discussion, 
we simply denote the trajectory by [ and draw the curve I in the subset E 
of the phase space R” with an arrow indicating the direction of the motion 
along I’ with increasing time. Cf. Figure 1. By the positive half-trajectory 
through the point x9 € E, we mean the motion along the curve 


ry, = {x € E| x = (t, x0), t > 0} 


Figure 1. A trajectory [' of (1) which approaches the w-limit point p € E 
as t — oO. 


Ix,» is similarly defined. Any trajectory T=T*UT-. 


Definition 1. A point p € E is an w-limit point of the trajectory $(-, x) 
of the system (1) if there is a sequence t, — oo such that 


lim (tn, xX) = p. 
n—co 
Similarly, if there is a sequence t, —> —oo such that 
lim $(tn,x) = q, 
n—co 


and the point q € E, then the point q is called an a-limit point of the 
trajectory ¢(-,x) of (1). The set of all w-limit points of a trajectory I° is 
called the w-limit set of I and it is denoted by w(I). The set of all a-limit 
points of a trajectory I is called the a-limit set of T and it is denoted by 
a(I). The set of all limit points of [, a([) Uw(I) is called the limit set 
of T. 
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Theorem 1. The a and w-limit sets of a trajectory T of (1), a([T) and 
w(I'), are closed subsets of E and if T is contained in a compact subset of 
R", thena(I) and w(T), are non-empty, connected, compact subsets of E. 


Proof. It follows from Definition 1 that w(T) Cc E. In order to show that 
w(I) is a closed subset of E, we let p, be a sequence of points in w(T) with 
Pn — p € R” and show that p € w(I). Let x9 € [. Then since p, € w(I), 
it follows that for each n = 1.2..... there is a sequence y(n) — oo ask —- oo 
such that 

lim (t\”. x9) = pn. 

k—900 
Furthermore, we may assume that foo > a since otherwise we can 
choose a subsequence of ie with this property. The above equation implies 
that for all n > 2, there is a sequence of integers K(n) > K(n— 1) such 
that for k > K(n), 


n 1 
|P(ty””. Xo) — Pn| < =. 


Let t, = ss Then t, — © and by the triangle inequality, 


1 
\b(tn. Xo) — p] < |O(tn, Xo) — Pal + [Pn — p] < ae IPn — p| - 0 


as n — oc. Thus p € w (PL). 

If [f Cc K, a compact subset of R”. and $(tn,xo) — p € w(T), then 
p € K since @(tn.Xo) € IT C K and K is compact. Thus, w(T) C K 
and therefore w(I‘) is compact since a closed subset of a compact set is 
compact. Furthermore, w(I) # 0 since the sequence of points @(n, x9) € K 
contains a convergent subsequence which converges to a point inw(T) Cc K. 
Finally, suppose that w(I’) is not connected. Then there exist two nonempty, 
disjoint, closed sets A and B such that w(I) = AUB. Since A and B are 
both bounded. they are a finite distance 6 apart where the distance from 
Ato B 


d(A,B)= i —yl. 
( ) goog y| 


Since the points of A and B are w-limit points of I’, there exists arbitrarily 
large t such that @(t.xo) are within 6/2 of A and there exists arbitrarily 
large t such that the distance of @(t, x9) from A is greater than 6/2. Since 
the distance d(@(t, xo), A) of O(t, Xo) from A is a continuous function of ¢, it 
follows that there must exist a sequence t,, — oo such that d(@(tn, xo), A) = 
6/2. Since {@(tn,xXo)} C K there is a subsequence converging to a point 
p € w(I) with d(p, A) = 6/2. But, then d(p, B) > d(A, B) — d(p, A) = 6/2 
which implies that p ¢ A and p ¢ B; i.e., p ¢ w(T), a contradiction. Thus, 
w(I) is connected. A similar proof serves to establish these same results 
for a(T). 
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Theorem 2. [fp is an w-limit point of a trajectory T of (1), then all other 
points of the trajectory $(-,p) of (1) through the point p are also w-limit 
points of T’; i.e., if p € w(T) then Tp C w(I) and similarly if p € a(I) 
then Ty C af). 


Proof. Let p € w(I) where I is the trajectory $(-,xo) of (1) through the 
point x9 € E. Let q be a point on the trajectory $(-, p) of (1) through the 
point p; i.e., q = $(t, p) for some t € R. Since p is an w-limit point of the 
trajectory $(-,xo), there is a sequence t, — oo such that $(tn, x0) — p. 
Thus by Theorem 1 in Section 2.3 of Chapter 2 (on continuity with respect 
to initial conditions) and property (ii) of dynamical systems, 


$(tn + t,x0) = O(t, O(tn, X0)) > O(#, p) =a. 


And since t, +t — 00, the point q is an w-limit point of (-, Xo). A similar 
proof holds when p is an a-limit point of T and this completes the proof 
of the theorem. 

It follows from this theorem that for all points p € w(I), ¢,(p) € w(L) 
for all t € R; ie., d,(W(T)) C w(L). Thus, according to Definition 2 in 
Section 2.5 of Chapter 2, we have the following result. 


Corollary. a([) and w(I) are invariant with respect to the flow @, of (1). 


The a- and w-limit sets of a trajectory I‘ of (1) are thus closed invariant 
subsets of E. In the next definition, a neighborhood of a set A is any open 
set U containing A and we say that x(t) — A as t — oo if the distance 
d(x(t), A) — 0 as t > 0. 


Definition 2. A closed invariant set A C E is called an attracting set of 
(1) if there is some neighborhood U of A such that for all x € U, %,(x) € U 
for all t > 0 and @,(x) — A as t — oo. An attractor of (1) is an attracting 
set which contains a dense orbit. 

Note that any equilibrium point x9 of (1) is its own @ and w-limit set 
since (t, Xo) = Xo for all ¢ € R. And if a trajectory I of (1) has a unique 
w-limit point x9, then by the above Corollary, x9 is an equilibrium point 
of (1). A stable node or focus, defined in Section 2.10 of Chapter 2, is the 
w-limit set of every trajectory in some neighborhood of the point; and a 
stable node or focus of (1) is an attractor of (1). However, not every w- 
limit set of a trajectory of (1) is an attracting set of (1); for example, a 
saddle xo of a planar system (1) is the w-limit set of three trajectories in 
a neighborhood N(x), but no other trajectories through points in N(xo) 
approach Xo as t — oo. 

If q is any regular point in a(I') or w(I) then the trajectory through q 
is called a limit orbit of [. Thus, by Theorem 2, we see that a(I) and w(I) 
consist of equilibrium points and limit orbits of (1). We now consider some 
specific examples of limit sets and attractors. 
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Example 1. Consider the system 
é = -y+2(1-2?-y%) 
y=rt+y(l—2z?-y’). 
In polar coordinates, we have 


*=r(1—r?) 

6=1. 
We see that the origin is an equilibrium point of this system; the flow spirals 
around the origin in the counter-clockwise direction; it spirals outward for 
0<r<1sincer > 0 for 0 <r < 1; and it spirals inward for r > 1 since 
r <0 for r > 1. The counter-clockwise flow on the unit circle describes 
a trajectory Io of (1) since 7 = 0 on r = 1. The trajectory through the 
point (cos 4, sin 4) on the unit circle at t = 0 is given by x(t) = (cos (t+ 
69), sin(t + 9))7. The phase portrait for this system is shown in Figure 2. 
The trajectory Io is called a stable limit cycle. A precise definition of a 
limit cycle is given in the next section. 


The stable limit cycle [9 of the system in Example 1, shown in Figure 2, 
is the w-limit set of every trajectory of this system except the equilibrium 
point at the origin. [9 is composed of one limit orbit and Tp is its own 
a and w-limit set. It is made clear by this example that what we really 
mean by a trajectory or orbit [ of the system (1) is the equivalence class 
of solution curves $(-,x) with x € TP; cf. Problem 3. We typically pick one 
representative @(-,xXo) with x9 € I, to describe the trajectory and refer to 
it as the trajectory I, through the point xo at time ¢ = 0. In the next 
section we show that any stable limit cycle of (1) is an attractor of (1). 


y 


‘DY. 
Ce 


Figure 2. A stable limit cycle 9 which is an attractor of (1). 
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We next present some examples of limit sets and attractors in R°. 


Example 2. The system 


£=-y+2(1— 2? -—2? -y’) 
y=arty(1—2*-2’-y’) 
z=0 
has the unit two-dimensional sphere S? together with that portion of the 
z-axis outside S? as an attracting set. Each plane z = 2g is an invariant 


set and for |zo| < 1 the w-limit set of any trajectory not on the z-axis is a 
stable cycle (defined in the next section) on S?. Cf. Figure 3. 


Example 3. The system 


& = -y+2(1—2? —y?) 
y=rty(1—2?-y’) 
z=a 


has the z-axis and the cylinder x? + y? = 1 as invariant sets. The cylinder 
is an attracting set; cf. Figure 4 where a > 0. 


Figure 3. A dynamical system with S? as part of its attracting set. 


3.2. Limit Sets and Attractors 197 


KS 


Figure 4. A dynamical system with a cylinder as its attracting set. 


If in Example 3 we identify the points (zx, y.0) and (x. y, 277) in the planes 
z = 0 and z = 27. we get a flow in R® with a two-dimensional invariant 
torus T? as an attracting set. The z-axis gets mapped onto an unstable 
cycle I’ (defined in the next section). And if a is an irrational multiple of 7 
then the torus T? is an attractor (cf. problem 2) and it is the w-limit set of 
every trajectory except the cycle [. Cf. Figure 5. Several other examples 
of flows with invariant tori are given in Section 3.6. 

In Section 3.7 we establish the Poincaré—-Bendixson Theorem which shows 
that the a and w-limit sets of any two-dimensional system are fairly simple 
objects. In fact. it is shown in Section 3.7 that they are either equilibrium 
points. limit cycles or a union of separatrix cycles (defined in the next 
section). However, for higher dimensional systems, the a and w-limit sets 
may be quite complicated as the next example indicates. A study of the 
strange types of limit sets that can occur in higher dimensional systems is 
one of the primary objectives of the book by Guckenheimer and Holmes 
(G/H]. An in-depth (numerical) study of the “strange attractor” for the 
Lorenz system in the next example has been carried out by Sparrow (S]. 
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Figure 5. A dynamical system with an invariant torus as an attracting set. 


Example 4. (The Lorenz System). The original work of Lorenz in 1963 
as well as the more recent work of Sparrow [S]} indicates that for certain 
values of the parameters o, p and , the system 


<= o(y-2z) 
y=pr—-—y—7Z 
z= —BPz+zry 


has a strange attracting set. For example for 0 = 10, p = 28 and 6 = 8/3, a 
single trajectory of this system is shown in Figure 6 along with a “branched 
surface” S. The attractor A of this system is made up of an infinite number 
of branched surfaces S which are interleaved and which intersect; however, 
the trajectories of this system in A do not intersect but move from one 
branched surface to another as they circulate through the apparent branch. 
The numerical results in [S] and the related theoretical work in [G/H] indi- 
cate that the closed invariant set A contains (i) a countable set of periodic 
orbits of arbitrarily large period, (ii) an uncountable set of nonperiodic 
motions and (iii) a dense orbit; cf. (G/H], p. 95. The attracting set A hav- 
ing these properties is referred to as a strange attractor. This example is 
discussed more fully in Section 4.5 of Chapter 4 in this book. 
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Figure 6. A trajectory [ of the Lorenz system and the corresponding 
branched surface S. Reprinted with permission from Guckenheimer and 
Holmes [G/H]. 


PROBLEM SET 2 


1. Sketch the phase portrait and show that the interval [—1, 1] on the 
z-axis is an attracting set for the system 
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t=2-27° 


y=—Y. 
Is the interval [—1,1] an attractor? Are either of the intervals (0, 1] 
or [1,00) attractors? Are any of the infinite intervals (0,00), [0, 00), 
(—1,00), [—1,00) or (—00, 00) on the z-axis attracting sets for this 
system? 


. (Flow on a torus; cf. [H/S], p. 241). Identify R* with C? having two 


complex coordinates (w, z) and consider the linear system 
w = 2miw 
Zz = 2raiz 

where a is an irrational real number. 


(a) Set a = e?"% and show that the set {a” € C | n = 1,2,...} is 
dense in the unit circle C = {z € C | |z| = 1}. 


(b) Let @, be the flow of this system. Show that for any integer n, 
d,,(w, z) = (w,a”z). 


(c) Let x9 = (wo, 20) belong to the torus T? = C x C C C?. Use 
(a) and (b) to show that w(Ix,) = T?. 
(d) Find w(T) and a(I) for any trajectory I‘ of this system. 


Hint: In part (a), use the following theorem to show that for e > 0 
there are positive integers m and n such that 


|a” 1| ant [enon fe ern | < €. 


Theorem (Hurwitz). Given any irrational number a and any N > 
0, there exist positive integers m and n such thatn > N and 


e-2< 3 


It then follows that for 0 = 2mna — 2mm and the integer K chosen 
such that K|0| < 27 < (K +1)|6|, any point on the circle C is within 
an € distance of one of the points in {(a")* € C|k =1,...,K}. 


. Let @, be the flow of the system (1). Define two solution curves 


Tr; = {(t,x)€ Rx E|te Rand x= G(t,x;)} 


j = 1,2 of (1) to be equivalent, [, ~ To, if there is a to € R such 
that for alte R 

$,(X2) = Pity (x;). 
Show that ~ is an equivalence relation; i.e., show that ~ is reflexive, 
symmetric and transitive. 


3.2. Limit Sets and Attractors 201 


4. Sketch the phase portrait of a planar system having 


(a) a trajectory [ with a([) = w(T) = {xo}, but TP ¥ {xo}. 


(b) a trajectory [I such that w(I) consists of one limit orbit (cf. 
Example 1). 


(c) atrajectory [such that w(I) consists of one limit orbit and one 
equilibrium point. 


(d) atrajectory I such that w(I) consists of two limit orbits and one 
equilibrium point (cf. Example 2 in Section 2.14 of Chapter 2). 


(e) atrajectory I such that w(I) consists of two limit orbits and two 
equilibrium points (cf. Example 1 in Section 2.14 of Chapter 2). 


(f) a trajectory [ such that w(I) consists of five limit orbits and 
three equilibrium points. 


Can w(T) consist of one limit orbit and two equilibrium points? How 
many different topological types, in R*, are there in case (d) above? 


5. (a) According to the corollary of Theorem 2, every w-limit set is an 
invariant set of the flow @, of (1). Give an example to show that 
not every set invariant with respect to the flow @, of (1) is the 
a or w-limit set of a trajectory of (1). 


(b) As we mentioned above, any stable limit cycle I is an attracting 
set; furthermore, [ is the w-limit set of every trajectory in a 
neighborhood of I’. Give an example to show that not every at- 
tracting set A is the w-limit set of a trajectory in a neighborhood 
of A. 


(c 


Vw 


Is the cylinder in Example 3 an attractor of the system in that 
example? 


6. Consider the Lorenz system 


<=oa(y-2z) 
y= pr—-y—z 
= ry — Bz 


with 0 > 0, p >O and G > 0. 


(a) Show that this system is invariant under the transformation 
(x,y. z,t) > (-z, —y, z,t). 


(b) Show that the z-axis is invariant under the flow of this system 
and that it consists of three trajectories. 
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(c) Show that this system has equilibrium points at the origin and 
at (£/6(p — 1),+/8(p — 1), — 1) for p > 1. For p > 1 show 
that there is a one-dimensional unstable manifold W“(0) at the 
origin. 

(d) For p € (0,1) use the Liapunov function V(z, y, z) = pr? +oy?+ 
oz? to show that the origin is globally stable; i.e., for p € (0,1), 
the origin is the w-limit set of every trajectory of this system. 


3.3 Periodic Orbits, Limit Cycles and Separatrix 
Cycles 


In this section we discuss periodic orbits or cycles, limit cycles and separa- 
trix cycles of a dynamical system (t,x) defined by 


x = f(x) (1) 


Definition 1. A cycle or periodic orbit of (1) is any closed solution curve 
of (1) which is not an equilibrium point of (1). A periodic orbit I is called 
stable if for each « > 0 there is a neighborhood U of I such that for all x € 
U,d(tt,T) < ¢;ie., if for all x € U and t > 0, d(@(t,x),T) < €. A periodic 
orbit I’ is called unstable if it is not stable; and [ is called asymptotically 
stable if it is stable and if for all points x in some neighborhood U of [ 


jim. d((t,x),T) = 0. 


Cycles of the system (1) correspond to periodic solutions of (1) since 
@(-,Xo) defines a closed solution curve of (1) if and only if for allt e R 
o(t + T,xo) = d(t,xo) for some T > 0. The minimal T for which this 
equality holds is called the period of the periodic orbit @(-, x9). Note that 
a center, defined in Section 2.10 of Chapter 2, is an equilibrium point 
surrounded by a continuous band of cycles. In general, the period T will 
vary continuously as we move along a continuous curve intersecting this 
family of cycles; however, in the case of a center for a linear system, the 
period is the same for each periodic orbit in the family. Each periodic orbit 
in the family of cycles encircling a center is stable but not asymptotically 
stable. We shall see in Section 3.5 that a periodic orbit 


r: x= ¥(t) 0<t<T 


of (1) if asymptotically stable only if 


[iv -£(4(t)) dt < 0. 
0 
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For planar systems we shall see in Section 3.4 that this condition with strict 
inequality is both necessary and sufficient for the asymptotic stability of 
a simple limit cycle T. An asymptotically stable cycle is referred to as an 
w-limit cycle and any w-limit cycle is an attractor of (1). 

Periodic orbits have stable and unstable manifolds just as equilibrium 
points do; cf. Section 2.7 in Chapter 2. Let [' be a (hyperbolic) periodic 
orbit and let N be a neighborhood of I’. As in Section 2.7, the local stable 
and unstable manifolds of I’ are given by 


S(T) = {x € N | d(¢,(x),T) - 0 as t — 00 and @,(x) € N for t > 0} 
and 
U(T) = {x € N | d(¢,(x),T) — 0 as t — —oo and ¢,(x) € N for t < O}. 


The global stable and unstable manifolds of I are then defined by 


wel) =U 4.(S(r)) 


t<0 


and 


w*(r) = J ¢(U(P)). 


t>0 


These manifolds are invariant under the flow ¢, of (1). The stability of 
periodic orbits as well as the existence and dimension of the manifolds 
S(T) and U(T) will be discussed more fully in the next two section. 


Example 1. The system 


&=-y+2(1—2? -y?) 
y=rty(1—2? -y’) 
z=2 


has an isolated periodic orbit in the z,y plane given by x(t) = (cost, 
sin t,0)7. There is an equilibrium point at the origin. The z-axis, the cylin- 
der zr? + y* = 1 and the z,y plane are invariant manifolds of this system. 
The phase portrait for this system is shown in Figure 1 together with a 
cross-section in the z,z plane; the dashed curves in that cross-section are 
projections onto the z, z plane of orbits starting in the z,z plane. In this 
example, the stable manifold of [, W*(I), is the z,y plane excluding the 
origin and the unstable manifold of f, W“(I), is the unit cylinder. The 
unit cylinder is an attracting set for this system. 
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Figure 1. Some invariant manifolds for the system of Example 1 and a 
cross-section in the z, z plane. 


A periodic orbit I’ of the type shown in Figure 1 where W°(T) #T and 
W“(l) #T is called a periodic orbit of saddle type. Any periodic orbit of 
saddle type is unstable. 


We next consider periodic orbits of a planar system, (1) with x € R?. 


Definition 2. A limit cycle [ of a planar system is a cycle of (1) which 
is the a or w-limit set of some trajectory of (1) other than T. If a cycle T 
is the w-limit set of every trajectory in some neighborhood of I’, then [ is 
called an w-limit cycle or stable limit cycle; if is the a-limit set of every 
trajectory in some neighborhood of I, then I is called an a-limit cycle or 
an unstable limit cycle; and if I’ is the w-limit set of one trajectory other 
than I and the a-limit set of another trajectory other than I, then I is 
called a semi-stable limit cycle. 


Note that a stable limit cycle is actually an asymptotically stable cycle 
in the sense of Definition 1 and any stable limit cycle is an attractor. 
Example 1 in Section 3.2 exhibits a stable limit cycle and if we replace ¢ by 
—t in that example (thereby reversing the direction of the flow), we would 
obtain an unstable limit cycle. In Problem 2 below we see an example of a 
semi-stable limit cycle. 

The following theorem is proved in [C/L], p. 396. In stating this theorem, 
we are using the Jordan curve theorem which states that any simple closed 
curve I separates the plane R? into two disjoint open connected sets having 
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I as their boundary. One of these sets, called the interior of I’, is bounded 
and simply connected. The other, called the exterior of ’, is unbounded 
and is not simply connected. 


Theorem 1. If one trajectory in the exterior of a limit cycle I’ of a pla- 
nar C}-system (1) has T as its w-limit set, then every trajectory in some 
exterior neighborhood U of T hasT as its w-limit set. Moreover, any tra- 
jectory in U spirals around T as t — 00 in the sense that it intersects any 
straight line perpendicular toT an infinite number of times at t = t, where 
tn, — OO. 


The same sort of result holds for interior neighborhoods of I‘ and also 
when I is the a-limit set of some trajectory. 

The next example shows that limit cycles can accumulate at an equi- 
librium point and Problem 1 below shows that they can accumulate on a 
cycle; cf. Example 6 in Section 2.10 of Chapter 2. 


Example 2. The system 


z= —y+2(z? + y*) sin ———— 
y+2(z°+y") =P 


1 
y= 2+ y(x? + y*) sin ——— 
y y( y") Tay 


for 2? + y? 4 0 with z = y = 0 at (0,0) defines a C!-system on R? which 
can be written in polar coordinates as 


3 


me 
r=r*sin- 
rT 


d=1. 


The origin is an equilibrium point and there are limit cycles T, lying on 
the circles r = 1/(n7). These limit cycles accumulate at the origin; i.e., 


lim d([',,0) = 0. 
n-—~0oO 


Each of the limit cycles I’, is stable while ['2n4.) is unstable. 


The next theorem, stated by Dulac [D] in 1923, shows that a planar 
analytic system, (1) with f(x) analytic in E C R?, cannot have an infinite 
number of limit cycles accumulating at a critical point as in the above 
example. Errors were recently found in Dulac’s original proof; however, 
these errors were corrected in 1988 by a group of French mathematicians, 
Ecalle, Martinet, Moussu and Ramis, and independently by the Russian 
mathematician Y. Ilyashenko, who modified and extended Dulac’s use of 
mixed Laurent-logarithmic type series. Cf. [8]. 
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Theorem (Dulac). In any bounded region of the plane, a planar analytic 
system (1) with f(x) analytic in R? has at most a finite number of limit 
cycles. Any polynomial system has at most a finite number of limit cycles 
in R?. 


The next examples describe two important types of orbits that can occur 
in a dynamical system: homoclinic orbits and heteroclinic orbits. They also 
furnish examples of separatrix cycles and compound separatrix cycles for 
planar dynamical systems. 


(> 
te 


Figure 2. A homoclinic orbit [ which defines a separatrix cycle. 


Example 3. The Hamiltonian system 
r=y 
yout? 
with Hamiltonian H(z, y) = y?/2—x?/2—2°/3 has solution curves defined 


by 


yP-a?- Fa =C 
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The phase portrait for this system is shown in Figure 2. The curve y? = 
z* + 2x3 /3, corresponding to C = 0, goes through the point (—3/2,0) and 
has the saddle at the origin (which also corresponds to C = 0) as its a and 
w-limit sets. The solution curve Fr Cc W*(0)N W*%(0) is called a homoclinic 
orbit and the flow on the simple closed curve determined by the union of 
this homoclinic orbit and the equilibrium point at the origin is called a 
separatriz cycle. 


Figure 3. Heteroclinic orbits [; and 2 defining a separatrix cycle. 


Example 1 in Section 2.14 of Chapter 2, the undamped pendulum, fur- 
nishes an example of heteroclinic orbits; the trajectory [; in Figure 1 of 
that section, having the saddle (—7,0) as its a-limit set and the saddle at 
(7,0) as its w-limit set is called a heteroclinic orbit. The trajectory [2 in 
that figure is also a heteroclinic orbit; cf. Figure 3 above. The flow on the 
simple closed curve S = I’; UP2 U {(7,0)} U {(—7, 0)} defines a separatrix 
cycle. 

A finite union of compatibly oriented separatrix cycles is called a com- 
pound separatriz cycle or graphic. An example of a compound separatrix 
cycle is given by the Hamiltonian system in Example 2 in Section 2.14 of 
Chapter 2. 
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Consider the following system. 
Z= —-2y 
y = 42(xz — 1)(z — 1/2). 


The phase portrait for this system is given in Figure 2 in Section 2.14 of 
Chapter 2. The two trajectories [; and [2 having the saddle at (1/2,0) as 
their a and w-limit sets are homoclinic orbits and the flow on the (nonsim- 
ple) closed curve S = T, UI, U {(1/2,0)} is a compound separatrix cycle. 
S is the union of two positively oriented separatrix cycles. Other examples 
of compound separatrix cycles can be found in [A-II]. Several examples of 
compound separatrix cycles are shown in Figure 4 below. 


e) 


Figure 4. Examples of compound separatrix cycles. 


PROBLEM SET 3 


1. (a) Given 
= —y+2(1—2? —y?)sin|1 — 2? — y?|-)/? 
y=rt+y(l— x? — y”) sin |1 — 2? — y?|—1/2 


for x2 ++ y? £1 with ¢ = —y and y = z for z? + y* = 1. Show 
that there is a sequence of limit cycles 


1 
+, = 
lor lt a 


for n = 1,2,3,... which accumulates on the cycle 
T: x = 7(t) = (cost, sint)?. 
What can you say about the stability of P+? 
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(b) Given 


= -y+2(1 — 2? - y*)sin(1 — 2? - y’)7! 
y=xot+y(1—2? — y’)sin(1 — 2? -—y?)7! 


for z?7 + y? #1 with z = —-y and y = z for r* + y* = 1. Show 
that there is a sequence of limit cycles 


| a r=yfl-— 
nt 


for n = +1,+2,+3,... which accumulates on the cycle [ given 
in part (a). What can you say about the stability of [,,? 


2. Show that the system 
z= —-y+2(1—2? -y’)? 
y=art+y(1—2?-y")? 


has a semi-stable limit cycle I’. Sketch the phase portrait for this 
system. 


3. (a) Show that the linear system x = Ax with 
0 -4 
a-[r 
has a continuous band of cycles 


Ta: Yq(t) = (a cos 2t, a/2sin 2t)? 


for a € (0, 00); cf. the example in Section 1.5 of Chapter 1. What 
is the period of each of these cycles? 


(b) Show that the nonlinear system 


t= VPP 
yorlar+y? 
has a continuous band of cycles 
Ta: Yq(t) = (acosat,asinat)™ 


for a € (0,00). Note that the period T, = 27/a of the cycle 
is a continuous function of a for a € (0,00) and that T, — 0 as 
a — 0 while T, — co asa — 0. 
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. Show that 


rT=y 
y=xrt+z? 
is a Hamiltonian system with 
H(z,y) = y*/2 — 27/2 — 23/3 


and that this system is symmetric with respect to the z-axis. Show 
that the origin is a saddle for this system and that (—1,0) is a center. 
Sketch the homoclinic orbit given by 


2 
yr =2?+ a 


Also, sketch all four trajectories given by this equation and sketch 
the phase portrait for this system. 


. Show that 


t=yt+y(z? + y’) 
y=2z—2(r? +?) 


is a Hamiltonian system with 4H(z,y) = (x? + y?)? — 2(z? — y?). 
Show that at = 0 along solution curves of this system and therefore 
that solution curves of this system are given by 


(2? + y*)? - 2(2? - y*) =C. 


Show that the origin is a saddle for this system and that (+1,0) are 
centers for this system. (Note the symmetry with respect to the z- 
axis.) Sketch the two homoclinic orbits corresponding to C' = 0 and 
sketch the phase portrait for this system noting the occurrence of a 
compound separatrix cycle for this system. 


. As in problem 5, sketch the compound separatrix cycle and the phase 


portrait for the Hamiltonian system 
r=y 
y=r@r- x? 


with H(z, y) = y?/2 — 27/24 24/4. 


7. (a) Write the system 


£=—-y+2(1—1’)(4-—717) 
y=rty(l—r’)(4—-1r7) 
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with r?2 = z?+y? in polar coordinates and show that this system 
has two limit cycles [, and Ig. Give solutions representing I) 
and Ig and determine their stability. Sketch the phase portrait 
for this system and determine all limit sets of trajectories of this 
system. 


(b 


~~ 


Consider the system 
g=—-y+a2(1—27 -y* — 27)(4-27 — y? — z?) 
y=rty(l—2?-y? - 2*)(4-2? -y? - 2”) 
z=0. 

For z = Zo, a constant, write the resulting system in polar coor- 

dinates and deduce that this system has two invariant spheres. 

Sketch the phase portrait for this system and describe all limit 


sets of trajectories of this system. Does this system have an at- 
tracting set? 


8. Consider the system 
&=-y+2(1—2?-y?)(4-2? -y’) 
y=rty(l—2?—y’)(4—27 —y’) 
z=2z. 


Show that there are two periodic orbits [, and [2 in the z,y plane 
represented by ,(¢) = (cost,sint)? and 7,(t) = (2cost,2sint)’, 
and determine their stability. Show that there are two invariant cylin- 
ders for this system given by r?+y? = 1 and z?+y? = 4; and describe 
the invariant manifolds W*(T;) and W“(I;) for j = 1,2. 


9. Reverse the direction of the flow in problem 8 (i.e., let t — —t) and 
show that the resulting system has the origin and the periodic orbit 
T2: x = (2cost, 2sint)? as attractors. 


3.4 The Poincaré Map 


Probably the most basic tool for studying the stability and bifurcations of 
periodic orbits is the Poincaré map or first return map, defined by Henri 
Poincaré in 1881; cf. [P]. The idea of the Poincaré map is quite simple: If 
. is a periodic orbit of the system 


x = f(x) (1) 


through the point x9 and & is a hyperplane perpendicular to I at xo, then 
for any point x € & sufficiently near xo, the solution of (1) through x at 
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t = 0, ¢,(x), will cross X again at a point P(x) near xo; cf. Figure 1. The 
mapping x — P(x) is called the Poincaré map. 

The Poincaré map can also be defined when & is a smooth surface, 
through a point xo € IT, which is not tangent to [ at xo. In this case, 
the surface & is said to intersect the curve I’ transversally at xo. The next 
theorem establishes the existence and continuity of the Poincaré map P(x) 
and of its first derivative DP(x). 


Figure 1. The Poincaré map. 


Theorem 1. Let E be an open subset of R" and let f € C'(E). Suppose 
that @,(Xo) 1s a periodic solution of (1) of period T and that the cycle 


[= {xe R"|x=9,(x), 0<t<T} 
is contained in E.. Let & be the hyperplane orthogonal to T at xo; i.e., let 
x = {x € R” | (x — xo) - f(x) = O}. 


Then there is a6 > 0 and a unique function r(x), defined and continuously 
differentiable for x € Ns5(Xo), such that T(x9) = T and 


97(x) (x) Ex 
for all x € N5(xo). 


Proof. The proof of this theorem is an immediate application of the im- 
plicit function theorem. For a given point x9 € I c E, define the function 


F(t, x) = [6,(x) — xo] - £(X0): 


It then follows from Theorem 1 in Section 2.5 of Chapter 2 that F € 
C!(R x E) and it follows from the periodicity of @,(xo) that F(T, xo) = 0. 
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Furthermore, since $(t,xo) = $;,(Xo) is a solution of (1) which satisfies 
$(T, Xo) = Xo, it follows that 


oe 2 aac Xo) -£(xo) 


= £(xo) - £(xo) = |f(xo0)|? # 0 


since Xo € T is not an equilibrium point of (1). Thus, it follows from the 
implicit function theorem, cf., e.g., Theorem 9.28 in [R], that there exists 
a 6 > 0 and a unique function 7(x) defined and continuously differentiable 
for all x € Ng(xo) such that 7(x9) = T and such that 


F(r(x),x) =0 


for all x € Ns(xo). Thus, for all x € Ns(xo), [6(7(x), x) — Xo] - f(x0) = 0, 
1.€., 


P(x) (x) € 2. 


Definition 1. Let [,&.6 and 7(x) be defined as in Theorem 1. Then for 
x € Ns5(x9) NX, the function 


P(x) = $,(x)(X) 


is called the Poincaré map for T at xo. 


Remark. It follows from Theorem 1 that P € C!(U) where U = N5(x9)N 
&. And the same proof as in the proof of Theorem 1, using the implicit 
function theorem for analytic functions, implies that if f is analytic in E 
then P is analytic in U. Fixed points of the Poincaré map, i.e., points x € & 
satisfying P(x) = x, correspond to periodic orbits $(-,x) of (1). And there 
is no loss in generality in assuming that the origin has been translated to the 
point x9 € D in which case x9 = 0, Y ~ R"~!, P: R®-!NNg(0) — R""! 
and DP(0) is represented by an (n—1) x (n—1) matrix. By considering the 
system (1) with t — —t, we can show that the Poincaré map P has a C’ 
inverse, P~!(x) = @_,,x)(x). Thus, P is a diffeomorphism; i.e., a smooth 
function with a smooth inverse. 


Example 1. In example 1 of Section 3.2 it was shown that the system 
z= —-y+2(1-—27-y’) 
y=rty(1—2?—y’) 
had a limit cycle I represented by -y(t) = (cost, sint)?. The Poincaré map 
for can be found by solving this system written in polar coordinates 


7 =r(1—r?) 
6=1 
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with r(0) = ro and 0(0) = 4. The first equation can be solved either as a 
separable differential equation or as a Bernoulli equation. The solution is 


given by 
1 -1/2 
r(t,ro) = f + (= - 1) a 
T0 


O(t,09) = t +O. 


If & is the ray 0 = Op through the origin, then © is perpendicular to [ and 
the trajectory through the point (ro,99) € SAT at t = 0 intersects the ray 
= 0 again at t = 27; cf. Figure 2. It follows that the Poincaré map is 


given by 
1 -1/2 
P(ro) = f + (= = 1) | ; 
T0 


Clearly P(1) = 1 corresponding to the cycle I and we see that 


and 


/ —4n7,-3 1 —4n iis 
P'(ro) =e “"rg” {1+ (a4 —l]le 


To 


and that P’(1) = e~4" <1. 


Figure 2. The Poincaré map for the system in Example 1. 


We next cite some specific results for the Poincaré map of planar systems. 
We return to a more complete discussion of the Poincaré map of higher 
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dimensional systems in the next section. For planar systems, if we translate 
the origin to the point x» € ['N%, the normal line & will be a line through 
the origin; cf. Figure 3 below. The point 0 € [NM & divides the line & into 
two open segments Dt and &~ where &* lies entirely in the exterior of I. 
Let s be the signed distance along © with s > 0 for points in L+ and s < 0 
for points in L-. 


Figure 38. The straight line 4 normal to [ at 0. 


According to Theorem 1, the Poincaré map P(s) is then defined for 
|s| < 6 and we have P(0) = 0. In order to see how the stability of the cycle 
I is determined by P’(0), let us introduce the displacement function 


d(s) = P(s) —s. 


Then d(0) = 0 and d’(s) = P’(s) — 1; and it follows from the mean value 
theorem that for |s| < 6 


d(s) =d‘(a)s 


for some o between 0 and s. Since d’(s) is continuous, the sign of d’(s) 
will be the same as the sign of d’(0) for |s| sufficiently small as long as 
d’(0) # 0. Thus, if d’(0) < 0 it follows that d(s) < 0 for s > 0 and that 
d(s) > 0 for s < 0; i.e., the cycle I is a stable limit cycle or an w-limit 
cycle. Cf. Figure 3. Similarly, if d’(0) > 0 then I is an unstable limit cycle 
or an a-limit cycle. We have the corresponding results that if P(0) = 0 and 
P’(0) < 1, then I is a stable limit cycle and if P(0) = 0 and P’(0) > 1, 
then [ is an unstable limit cycle. Thus, the stability of [ is determined by 
the derivative of the Poincaré map. 
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In this regard, the following theorem which gives a formula for P’(0) in 
terms of the right-hand side f(x) of (1), is very useful; cf. (A-II], p. 118. 


Theorem 2. Let E be an open subset of R? and suppose that f € C}(E). 
Let +(t) be a periodic solution of (1) of period T. Then the derivative of 
the Poincaré map P(s) along a straight line X normal toT = {x € R? | 
x = y(t) —(0),0 <t <T} atx =0 is given by 


T 
P’(0) = exp | V - f(-y(t)) dt. 


Corollary. Under the hypotheses of Theorem 2, the periodic solution y(t) 
is a stable limit cycle if 


T 
| V -£(4(t)) dt <0 
0 


and it is an unstable limit cycle if 


T 
- V -£(4(t)) dt > 0. 
0 


It may be a stable, unstable or semi-stable limit cycle or it may belong to 
a continuous band of cycles if this quantity is zero. 


For Example 1 above, we have y(t) = (cost,sint)?, V-f(z,y) = 2- 
Ax? — 4y? and 
2z 2n 
V -f(y(t)) dt = (2 — 4cos? t — 4sin? t) dt = —4z. 
0 
Thus, with s = r — 1, it follows from Theorem 2 that 
P’(0) =e" ** 


which agrees with the result found in Example 1 by direct computation. 
Since P’(0) < 1, the cycle -+y(t) is a stable limit cycle in this example. 


Definition 2. Let P(s) be the Poincaré map for a cycle I of a planar 
analytic system (1) and let 


d(s) = P(s)-—s 
be the displacement function. Then if 
d(0) = d'(0) =--- = d*-(0) =0 and d*)(0) £0, 


I is called a multiple limit cycle of multiplicity k. If k = 1 then I is called 
a simple limit cycle. 
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We note that r = {x € R? |x = y(t),0 < t < T} is a simple limit cycle 
of (1) iff 


T 
[ ¥-temyae 40. 


It can be shown that if k is even then I is a semi-stable limit cycle and if k 
is odd then L is a stable limit cycle if d‘*)(0) < 0 andT is an unstable limit 
cycle if d‘*)(0) > 0. Furthermore, we shall see in Section 4.5 of Chapter 4 
that if lis a multiple limit cycle of multiplicity k, then k limit cycles can be 
made to bifurcate from I under a suitable small perturbation of (1). Finally, 
it can be shown that in the analytic case, d‘*)(0) = 0 for k = 0,1,2,... iff 
I’ belongs to a continuous band of cycles. 

Part of Dulac’s Theorem for planar analytic systems, given in Section 3.3, 
follows immediately from the analyticity of the Poincaré map for analytic 
systems: Suppose that there are an infinite number of cycles [, which 
accumulate on a cycle I’. Then the Poincaré map P(s) for I is an analytic 
function with an infinite number of zeros in a neighborhood of s = 0. It 
follows that P(s) = 0 in a neighborhood of s = 0; i.e., the cycles I’, belong 
to a continuous band of cycles and are therefore not limit cycles. This result 
was established by Poincaré (P] in 1881: 


Theorem (Poincaré). A planar analytic system (1) cannot have an infi- 
nite number of limit cycles which accumulate on a cycle of (1). 


For planar analytic systems, it is convenient at this point to discuss the 
Poincaré map in the neighborhood of a focus and to define what we mean 
by a multiple focus. These results will prove useful in Chapter 4 where we 
discuss the bifurcation of limit cycles from a multiple focus. 

Suppose that the planar analytic system (1) has a focus at the origin 
and that det Df(0) 4 0. Then (1) is linearly equivalent to the system 


<= az — by + p(z,y) 
y = br + ay+ q(z, y) (2) 


with b # 0 where the power series expansions of p and q begin with second 
or higher degree terms. In polar coordinates, this system has the form 


? = ar + 0(r?) 
6 = b+0(r). 


Let r(t,ro,90), 9(t,r0,40) be the solution of this system satisfying 
r(0,ro,90) = ro and 6(0,ro, 90) = 9. Then for ro > O sufficiently small 
and b > 0, O(t, ro, 90) is a strictly increasing function of t. Let t(0, ro, 4) 
be the inverse of this strictly increasing function and for a fixed 09, define 
the function 


P(ro) = r(t(00 + 27, r0, 90), To; 90). 
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Then for all sufficiently small ro > 0, P(ro) is an analytic function of ro 
which is called the Poincaré map for the focus at the origin of (2). Similarly, 
for b < 0, O(t, ro, 40) is a strictly decreasing function of t and the formula 


P(ro) = r(t(99 — 27, ro, 9), To, 90) 


is used to define the Poincaré map for the focus at the origin in this case. 
Cf. Figure 4. 


b>0O b<O 


Figure 4. The Poincaré map for a focus at the origin. 


The following theorem is proved in [A-II], p. 241. 


Theorem 3. Let P(s) be the Poincaré map for a focus at the origin of 
the planar analytic system (2) with b #0 and suppose that P(s) is defined 
for 0 < s < 59. Then there is a 6 > 0 such that P(s) can be extended to 
an analytic function defined for |s| < 5. Furthermore, P(0) = 0, P’(0) = 
exp(27a/|b|), and if d(s) = P(s) — s then d(s)d(—s) < 0 for 0 < |s| < 6. 


The fact that d(s)d(—s) < 0 for 0 < |s| < 6 can be used to show that if 
d(0) = d'(0) =--- =d‘*-(0) =0 and d**)(0) £0 


then k is odd; i.e., k = 2m +1. The integer m = (k — 1)/2 is called the 
multiplicity of the focus. If m = 0 the focus is called a simple focus and 
it follows from the above theorem that the system (2), with b # 0, has a 
simple focus at the origin iff a # 0. The sign of d’(0), ie., the sign of a 
determines the stability of the origin in this case. If a < 0, the origin is a 
stable focus and if a > 0, the origin is an unstable focus. If d’(0) = 0, i-e., 
if a = 0, then (2) has a multiple focus or center at the origin. If d’(0) = 0 
then the first nonzero derivative o = d‘*)(0) ¥ 0 is called the Liapunov 
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number for the focus. If o < 0 then the focus is stable and if o > 0 it is 
unstable. If d’(0) = d”(0) = 0 and d’’(0) # 0 then the Liapunov number 
for the focus at the origin of (2) is given by the formula 


o=d"(0)= = {[3(ax0 +bo3)+(a12 + b21)] 


se : [2(a2obe0 — ao2bo2) — 211 (A092 +220) +811 (b02 +20) (3) 


where _ -_ 
p(z,y)= >> aizty? and g(z,y)= S > byxty 
i+j>2 i+j>2 
in (2); cf. [A-II], p. 252. 
This information will be useful in Section 4.4 of Chapter 4 where we shall 
see that m limit cycles can be made to bifurcate from a multiple focus of 
multiplicity m under a suitable small perturbation of the system (2). 


PROBLEM SET 4 


1. Show that -+(t) = (2cos 2t, sin 2t)? is a periodic solution of the system 


that lies on the ellipse (1/2)? + y* = 1; i.e., y(t) represents a cycle 
of this system. Then use the corollary to Theorem 2 to show that I 
is a stable limit cycle. 


2. Show that 7(t) = (cost, sint,0)7 represents a cycle I of the system 
¢ = -y+2(1— 2? -y’) 
y=r+y(1—2?—y’) 
zZ=2. 

Rewrite this system in cylindrical coordinates (r,0,z); solve the re- 


sulting system and determine the flow @,(ro, 90, 20); for a fixed 0 € 
(0, 27), let the plane 


>= {x € R*|0=%,r>0,z€ R} 


and determine the Poincaré map P(ro, 2) where P: & — £. Compute 
DP (ro, zo) and show that DP(1,0) = e?"® where the eigenvalues of 
B are A, = —2 and A2 = 1. 
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3. (a) Solve the linear system x = Ax with 


a a 
a 
and show that at any point (zo,0), on the z-axis, the Poincaré 
map for the focus at the origin is given by P(zo9) = ro exp(27a/ 


|b]). For d(x) = P(x) — 2, compute d’(0) and show that d(—z) = 


—d(z). 


(b 


——Z 


Write the system 
£=—-y+2(1—2? —y?) 
y=art+y(1—2?—y’) 


in polar coordinates and use the Poincaré map P(ro) determined 
in Example 1 for ro > 0 to find the function P(s) of Theorem 3 
which is analytic for |s| < 6. (Why is P(s) analytic? What is the 
domain of analyticity of P(s)?) Show that d’(0) = e@” -1>0 
and hence that the origin is a simple focus which is unstable. 


4. Show that the system 
¢=-y+2(1—2? -y?)? 
y=art+y(l—-2?—y’)? 


has a limit cycle I represented by y(t) = (cost, sin t)?. Use Theorem 2 
to show that I is a multiple limit cycle. Since I‘ is a semi-stable limit 
cycle, cf. Problem 2 in Section 3.3, we know that the multiplicity k 
of I is even. Can you show that k = 2? 


5. Show that a quadratic system, (2) with a =0, 6 £0, 
p(z,y)= S > arty? and g(z,y)= S> byrty, 
i+j=2 i+j=2 


either has a center or a focus of multiplicity m > 2 at the origin if 
a20 + ao2 = b20 + bog = 0. 


3.5 The Stable Manifold Theorem for Periodic 
Orbits 


In Section 3.4 we saw that the stability of a limit cycle I’ of a planar system 
is determined by the derivative of the Poincaré map, P’(xo), at a point xo € 
I; in fact, if P’(xo) < 1 then the limit cycle I is (asymptotically) stable. 
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In this section we shall see that similar results, concerning the stability of 
periodic orbits, hold for higher dimensional systems 


x = f(x) (1) 


with f € C'(E) where E is an open subset of R”. Assume that (1) has a 
periodic orbit of period T 


r:x=7(t), O<t<T, 


contained in E. In this case, according to the remark in Section 3.4, the 
derivative of the Poincaré map, DP(xo), at a point x9 € [is an (n — 1) x 
(n — 1) matrix and we shall see that if ||DP(xo)|| < 1 then the periodic 
orbit [‘ is asymptotically stable. 

We first of all show that the (n—1) x(n—1) matrix DP(xo) is determined 
by a fundamental matrix for the linearization of (1) about the periodic orbit 
[. The linearization of (1) about T is defined as the nonautonomous linear 
system 

x = A(t)x (2) 
with 
A(t) = Df(y(t)). 
The n x n matrix A(t) is a continuous, T-periodic function of ¢ for all 
t € R. A fundamental matriz for (2) is a nonsingular n x n matrix ®(t) 
which satisfies the matrix differential equation 


} = A(t)® 


for all ¢ € R. Cf. Problem 4 in Section 2.2 of Chapter 2. The columns of 
(t) consist of n linearly independent solutions of (2) and the solution of 
(2) satisfying the initial condition x(0) = xo is given by 


x(t) = &(t)6—!(0)xpo. 


Cf. [W], p. 77. For a periodic matrix A(t), we have the following result 
known as Floquet’s Theorem which is proved for example in [H] on pp. 60- 
61 or in [C/L] on p. 79. 


Theorem 1. If A(t) is a continuous, T-periodic matriz, then for allteE R 
any fundamental matriz solution for (2) can be written in the form 


&(t) = Q(t)e** (3) 
where Q(t) is a nonsingular, differentiable, T-periodic matriz and B is a 


constant matriz. Furthermore, if &(0) = I then Q(0) =I. 


Thus, at least in principle, a study of the nonautonomous linear sys- 
tem (2) can be reduced to a study of an autonomous linear system (with 
constant coefficients) studied in Chapter 1. 
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Corollary. Under the hypotheses of Theorem 1, the nonautonomous linear 
system (2), under the linear change of coordinates 


y =Q7'(t)x, 


reduces to the autonomous linear system 


y = By. (4) 


Proof. According to Theorem 1, Q(t) = 8(t)e~*. It follows that 
Q'(t) = ®'(t)e~ 7" — &(t)e"?*B 
= A(t)®(t)e~ 7" — &(t)e~3*B 
= A(t) Q(t) = Q(t)B, 


since e~®* and B commute. And if 


y(t) = Q7*(t)x(t) 
or equivalently, if 
x(t) = Q(t)y(t), 


then 


x'(t) = Q"(t)y(t) + Q(t)y'(t) 
= A(t)Q(t)y(t) — Q(t) By(t) + Q(t)y"(t) 
= A(t)x(t) + Q(¢)[y"(t) — By(t)]. 


Thus, since Q(t) is nonsingular, x(t) is a solution of (2) if and only if y(t) 
is a solution of (4). 

However, determining the matrix Q(t) which reduces (2) to (4) or deter- 
mining a fundamental matrix for (2) is in general a difficult problem which 
requires series methods and the theory of special functions. 

As we shall see, if ®(t) is a fundamental matrix for (2) which satisfies 
©(0) = J, then ||DP(xo)|| = ||®(T)|| for any point x9 € I. It then follows 
from Theorem 1 that || DP(xo)|] = ||e?7|||. The eigenvalues of e?7 are given 
by e*/7 where A;, j = 1,...,n, are the eigenvalues of the matrix B. The 
eigenvalues of B,A;, are called characteristic exponents of y(t) and the 
eigenvalues of e?7,e*»7, are called the characteristic multipliers of -y(t). 
Even though the characteristic exponents, 4;, are only determined modulo 
27i, they suffice to uniquely determine the magnitudes of the characteristic 
multipliers e*47 which determine the stability of the periodic orbit I’. This 
is made precise in what follows. 

For x € E, let $,(x) = (t,x) be the flow of the system (1) and let 
y(t) = @,(Xo) be a periodic orbit of (1) through the point x9 € E. Then 
since $(t, x) satisfies the differential equation (1) for all t € R, the matrix 


H(t,x) = D@,(x) 
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satisfies DH (t,x) 
x 
ae = DE( G(x) H(t.) 
for all t € R. Thus, for x = xp and ¢t € R, the function ®(t) = H(t,xo) 
satisfies 


& = Df(y(t))® 
and 
©(0) =I. 


(Cf. the corollary in Section 2.3 of Chapter 2.) That is, H(t,x9) is the 
fundamental matrix for (2) which satisfies ®(0) = H(0,x9) = J. Thus, by 
Theorem 1, 

H(t, xo) = Q(t)e** 
where Q(t) is T-periodic and satisfies Q(0) = J. It follows that 


H(T,xo) = e®7. 


The next theorem shows that one of the characteristic exponents of y(t) 
is always zero, i.e., one of the characteristic multipliers is always 1, and 
if we suppose that A, = 0 and choose the basis for R” so that the last 
column of e87 is (0,...,0,1)7, then DP(xo) is the (n — 1) x (n—1) matrix 
obtained by deleting the nth row and column in e87. As in the remark in 
Section 3.4, there is no loss in generality in assuming that the origin has 
been translated to the point x9 € [. 


Theorem 2. Suppose that f € C'(E) where E is an open subset of R” 
and that y(t) = @,(0) is a periodic orbit of (1) contained in E. For 6 > 0 
sufficiently small and x € © Ng(0), let P(x) be the Poincaré map for 
(t) at O where & is the (n —1)-dimensional hyperplane orthogonal to IT at 
0. If Ay,...,An are the characteristic exponents of y(t), then one of them, 
say Xn, is zero and the characteristic multipliers e*37, j = 1,...,n —1, 
are the eigenvalues of DP(O). In fact, if the basis for R” is chosen so 
that (0) = (0,...,0,1)7 then the last column of H(T,0) = Dd@,z(0) is 
(0,...,0,1)7 and DP(O) is obtained by deleting the last row and column 
in H(T,O). 


Proof. Since the periodic orbit y(t) = @,(0) satisfies 
¥'(t) = F(y(t)), 
it follows that 
yi" (t) = DE(y(t))¥'(2)- 


Thus, 7‘(t) is a solution of the nonautonomous linear system (2) and the 
initial condition +/(0) = £(0). Then since the matrix 


b(t) = H(t, 0), 
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defined above, is the fundamental matrix for (2) satisfying ®(0) = J, it 
follows that 


¥'(t) = B(t)£(0). 
For t = T, +'(T) = f(0) and we see that 
H(T,0)f(0) = £(0); 


i.e., 1 is an eigenvalue of H(T,0) with eigenvector f(0). Since H(T,0) = 

eT this implies that one of the eigenvalues of B is zero. Suppose that A, = 

0 and that the basis for R" has been chosen so that f(0) = (0,...,0,1)?. 

Then (0,...,0,1)7 is an eigenvector of H(T,0) corresponding to the eigen- 

value e*"7 = 1. It follows that the last column of H(T,0) is (0,...,0,1)7. 
For 6 > 0 sufficiently small and x € N(0), define the function 


h(x) = $(7(x), x) 


where 7(x) is the function defined by Theorem 1 in Section 3.4. Then the 
Poincaré map P is the restriction of h to the subspace . Since 


Dh(x) = Dd(7(x), x) 
= 28 (r(x), x)Dr(x) + D@,(x)(x) 
. So (r(x),x)Dr(x) + H(r(x),x), 


for x = 0 we obtain 


Dh(0) = f(0)Dr(0) + H(T,0) 


0 «0 0 
0 
= pa ce H(T,0) 
0 --- 0 0 0 
Or Or 1 
Bz, aa dz, 


And since with respect to the above basis DP(0) consists of the first (n—1) 
rows and columns of Dh(0), it follows that 


DP(0) = H(T,0) 
where H(T,0) consists of the first (n — 1) rows and columns of H(T, 0). 


Remark. Even though it is generally very difficult to determine a funda- 
mental matrix ®(t) for (2), this theorem gives us a means of computing 
DP(xo) numerically; ie., DP(xo) can be found by determining the effect 
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on the periodic orbit -y(t) = @,(xo) of small variations in the initial con- 
ditions x9 € R” defining the periodic orbit y(t). In fact, in a coordinate 
system with its origin at a point on the periodic orbit [ and the r,-axis 
tangent to I at that point and pointing in the same direction as the motion 
along I, 


06; 
T 
32 (7.0)| 
where i.j = 1....,(n — 1) and $(t, x) = ,(x) is the flow defined by (1). 
As was noted earlier, the stability of the periodic orbit y(t) is determined 


by the characteristic exponents A),..., An—1 or by the characteristic multi- 
pliers e*!7....,e? 


DP(0) = | 


ern-1T_ This is made precise in the next theorem. The proof 
of this theorem is similar to the proof of the Stable Manifold Theorem in 
Section 2.7 in Chapter 2; cf. [H], p. 255. 


Theorem (The Stable Manifold Theorem for Periodic Orbits). Let 
f<€C'(E) where E is an open subset of R" containing a periodic orbit 


lr: x = ¥(t) 


of (1) of period T. Let @, be the flow of (1) and y(t) = ,(xo). If k of the 
characteristic exponents of y(t) have negative real part whereOQ< k <n-1 
and n—k-—1 of them have positive real part then there is a 6 > 0 such that 
the stable manifold of T, 


S(T) = {x € No(T) | d(@,(x),P) + 0 as t > c0 
and $,(x) € Ns(T) for t > 0} 


is a (k+1)-dimensional, differentiable manifold which is positively invariant 
under the flow @, and the unstable manifold of I, 


U(T) = {x € N(T) | d(¢,(x), T°) - 0 as t + —o0 
and @,(x) € Ns(T) for t < 0} 


is an (n — k)-dimensional, differentiable manifold which is negatively in- 
variant under the flow o,. Furthermore, the stable and unstable manifolds 
of I intersect transversally in T. 


Remark 1. The local stable and unstable manifolds of [, S([) and U(T), 
in the Stable Manifold Theorem can be used to define the global stable and 
unstable manifolds of T, W°([) and W*“(T), as in Section 3.3. It can be 
shown that W°([) and W"(I) are unique, invariant, differentiable mani- 
folds which have the same dimensions as S(T) and U(T) respectively. Also, 
if f € C’(E), then it can be shown that W°(I) and W“(L) are manifolds 
of class C’’. 


Remark 2. Suppose that the origin has been translated to the point xo 
so that y(t) = $,(0). Let A; = a, + ib; be the characteristic exponents 
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of the periodic orbit y(t) and let e*)7 be the characteristic multipliers of 
y(t), ie., e427 are the eigenvalues of the real n x n matrix 


&(T) = H(T,0). 


Furthermore, suppose that u; = f(0) and that we have a basis of gener- 
alized eigenvectors of ®(T) for R” given by {uj,..., Ux, Uk41, Vi41;-- +5 
Um; Vm} as in Section 1.9 of Chapter 1. We then define the stable, unstable 
and center subspaces of the periodic orbit T at the point 0 € T as 


E*(T) = Span{u;, v; | aj< 0} 
E*(l) = Span{u,;,v,; | a; = 0} 
E*(T) = Span{u,, Vv; | a;> 0}. 


It can then be shown that the stable and unstable manifolds W°(T) and 
W*(L) of TI’ are tangent to the stable and unstable subspaces E*(I) and 
E“(I) of [ at the point 0 € I respectively. 

If Re(A;) # 0 for j = 1,...,n —1, this theorem determines the be- 
havior of trajectories near TI’. If Re(A;) # 0 for j = 1,...,.n —1 then I 
is called a hyperbolic periodic orbit. The periodic orbit in Example 1 of 
Section 3.3 is a hyperbolic periodic orbit with a two-dimensional stable 
manifold and two-dimensional unstable manifold. The characteristic expo- 
nents for that example are determined later in this section. If two or more 
of the characteristic exponents have zero real part then the periodic orbit 
I has a nontrivial center manifold, denoted by W°(I). In Example 2 in 
Section 3.2, the unit sphere S? is the center manifold for the periodic orbit 
y(t) = (cost, sint,0)7. 

The next theorem shows that not only do trajectories in the stable man- 
ifold S([‘) approach [ as t — oo, but that the motion along trajectories in 
S(T) is synchronized with the motion along I’. We assume that the char- 
acteristic exponents have been ordered so that Re(A;) < 0 for j = 1,...,k 
and Re(A;) > 0 for j = k+1,...,n—1. This theorem is proved for example, 
in Hartman [H], p. 254. 


Theorem 3. Under the hypotheses of the above theorem, there is ana > 0 
and a K > 0 such that Re(A;) < -a@ for j =1,...,k and Re(A;) > a for 
j =k+1,...,n—-1 and for eachx € S(T) there exists an asymptotic phase 
to such that for allt > 0 


|o.(x) — y(t — to)| < Ke7*"/7; 


and similarly for each x € U(T) there exists an asymptotic phase to such 
that for allt < 0 
lb,(x) — y(t — to)| < Ke®*/7; 


Example 1. Consider the system 


3 


Z=2r-y-s ~— ry” 
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y=rty-ay-y° 
z= Xz. 
Cf. Example 1 in Section 3.3. There is a periodic orbit 
Tr: +(t) = (cost, sin t, 0)? 
of period T = 27. We compute 


1-37?-y* -1-2zy 0 
Df(x)=| 1-Qzy 1-—27-3y? 0 
0 0 A 


where x = (z,y,z)?. The linearization of the above system about the 
periodic orbit +(t) is then given by 


x = A(t)x 
where the periodic matrix 
—2cos?t -—l—sin2t 0 
A(t)=|1-—sin2t -2sin?t 0 
0 0 p\ 
This nonautonomous linear system has the fundamental matrix 


e~**cost —sint 0 
&(t)= |e **sint cost 0 
0 0 et 


which satisfies (0) = J. The serious student should verify that ®(¢) satis- 
fies 6 = A(t); cf. Problem 3 in Section 1.10 of Chapter 1. Once we have 
found the fundamental matrix for the linearized system, it is easy to see 


that 
B(t) = Q(t)e** 


where the periodic matrix 


0 0 1 


—2 0 0 
B=| 0 0 QO]. 
004A 


As in Theorem 2, deleting the row and column containing the zero eigen- 


value determines 
eT 
DP(xo9) = 0 


cost —sint 0 
Q(t)= |sint cost 0 
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where Xo = (1,0,0)7, T = 27, and the characteristic exponents A, = —2 
and Aj = A. For A > 0, as in Example 1 in Section 3.3, there is a two- 
dimensional stable manifold W*(I) and a two-dimensional unstable man- 
ifold W“(T) which intersect orthogonally in -y; cf. Figure 1 in Section 3.3. 
For \ < 0, there is a three-dimensional stable manifold R* ~ {0}, and a 
one-dimensional unstable manifold, I’. If A = 0, there is a two-dimensional 
stable manifold and a two-dimensional center manifold; the center manifold 
W°<(L) is the unit cylinder. 

This example is more easily treated by writing the above system in cylin- 
drical coordinates as 


r= r(l —r*) 


d=1 


z= Xz. 


The Poincaré map can then be computed directly by solving the above 
system as in Example 1 of Section 3.4: 


P(r, z) = f + (= _ 1) et] ~1/2 


It then follows that 


and that 


e 4 0 
prio=["" 2 


as above. However, converting to polar coordinates does not always simplify 
the problem and allow us to compute the Poincaré map; cf. Problems 2 and 
8 below. Just as there is a center manifold tangent to the center subspace 
E* at a nonhyperbolic equilibrium point of (1), there is a center manifold 
tangent to the center subspace E‘°(I) of a nonhyperbolic periodic orbit I. 
We cite this result for future reference; cf., e.g., [Ru], p. 32. 


Theorem 4 (The Center Manifold Theorem for Periodic Orbits). 
Let f € C™(E) with r > 1 where E is an open subset of R® containing a 
periodic orbit 

lr: x = ¥(¢t) 
of (1) of period T. Let d, be the flow of (1) and let +(t) = ,(xo). If k of 
the characteristic exponents have negative real part, 7 have positive real part 
and m = n—k—j have zero real part, then there is an m-dimensional center 
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manifold of f, W°([), of class C" which is invariant under the flow ¢,. 
Furthermore, W°(T),W*“([) and W°(L) intersect transversally inT and if 
the origin has been translated to the point xo so that y(t) = $,(0), then 
W°<([) is tangent to the center subspace of [, E°(I1), at the pointOeT. 


We next give some geometrical examples of stable manifolds, unstable 


manifolds and center manifolds of periodic orbits that can occur in R? 
(Figures 1-4): 


Ay 


Figure 1. Periodic orbits with a three-dimensional stable manifold. These 
periodic orbits are asymptotically stable. 


Figure 2. A periodic orbit with two-dimensional stable and unstable man- 
ifolds. This periodic orbit is unstable. 


We conclude this section with one last result concerning the stability 
of periodic orbits for systems in R” which is similar to the corollary in 
Section 3.4 for limit cycles of planar systems. This theorem is proved in [H] 
on p. 256. 
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= 


Figure 3. A periodic orbit with two-dimensional stable and center mani- 
folds. This periodic orbit is stable, but not asymptotically stable. 


Figure 4. A periodic orbit with a three-dimensional center manifold. This 
periodic orbit is stable, but not asymptotically stable. 


Theorem 5. Let f € C!(E) where E is an open subset of R” containing 
a periodic orbit >(t) of (1) of period T. Then +(t) is not asymptotically 
stable unless 


T 
/ V -f£(y(t)) dt < 0. 
0 
Note that in Example 1, V - f(x) = 2 — 4r? + A and 
T 
i V -£(-(t)) dt = (A—2)2n >0 
0 


if \ > 2. And \ > 2 certainly implies that the periodic orbit y(t) in that 
example is not asymptotically stable. In fact, we saw that A > 0 implies 
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that -+y(t) is a periodic orbit of saddle type which is unstable. This example 
shows that for dimension n > 3, the condition 


T 
[ V -f(-(t)) dt <0 
0 


does not imply that -+y(t) is an asymptotically stable periodic orbit as it 
does for n = 2; cf. the corollary in Section 3.4. 


PROBLEM SET 5 


1. Show that the nonlinear system 
g=-y+r27 
yarty2” 
z= —2(x? + y?) 
has a periodic orbit -y(t) = (cost, sint,0)7. Find the linearization of 
this system about 7(t), the fundamental matrix ®(t) for this (au- 
tonomous) linear system which satisfies 6(0) = J, and the character- 


istic exponents and multipliers of y(t). What are the dimensions of 
the stable, unstable and center manifolds of -y(t)? 


2. Consider the nonlinear system 


3 
¢=2—4y—— —2y’ 

4 

2 

vy 
yarty-—-y 


ae 
Show that +(t) = (2cos2t,sin 2t,0)7 is a periodic solution of this 
system of period T = 7; cf. Problem 1 in Section 3.4. Determine the 
linearization of this system about the periodic orbit -y(t), 
x = A(t)x, 
and show that 
e**cos2t_ —2sin2t 0 


&(t) = se! sin2t cos2t 0 
0 0 et 


is the fundamental matrix for this nonautonomous linear system 
which satisfies 6(0) = J. Write ®(t) in the form of equation (3), 
determine the characteristic exponents and the characteristic multi- 
pliers of -y(t), and determine the dimensions of the stable and unstable 
manifolds of y(t). Sketch the periodic orbit y(t) and a few trajectories 
in the stable and unstable manifolds of +(¢). 
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3. If &(t) is the fundamental matrix for (2) which satisfies (0) = J, 
show that for all xo € R” and t € R, x(t) = ®(t)xo is the solution 
of (2) which satisfies the initial condition x(0) = xo. 


4. (a) Solve the linear system 
r=-y 


y=r 
i= 


with the initial condition x(0) = xo = (Zo, yo, 20)? . 
(b) Let u(t, xo) = ,(xX0) be the solution of this system and compute 


#(t) = Dd,(xo) = s(t, 0) 


(c) Show that -y(t) = (cost,sint,1 — cost)? is a periodic solution 
of this system and that ®(t) is the fundamental matrix for (2) 
which satisfies (0) = I. 


5. (a) Let (t) be the fundamental matrix for (2) which satisfies 6(0) = 
I. Use Liouville’s Theorem, (cf. [H], p. 46) which states that 


t 
det &(t) = exp i trA(s)ds, 
0 


to show that if m; = e*s7, j = 1,...,n are the characteristic 
multipliers of -y(t) then 


> m; = tr®(T) 


j=l 
and 


n T 
I] m;= exp | trA(t)dt. 
j=l 


(b) For a two-dimensional system, (2) with x € R?, use the above 
result and the fact that one of the multipliers is equal to one, 
say M2 = 1, to show that the characteristic exponent 


1/7 i 
Ay = z | trA(t)dt = zf V - f(-y(t))dt 
(cf. [A-IT], p. 118) and that 


T 
tré(T) = 1+ exp | V - f£(y(t))dt. 
0 
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6. Use Liouville’s Theorem (given in Problem 5) and the fact that 
H(t,xo) = (t) is the fundamental matrix for (2) which satisfies 
(0) = J to show that for allte R 


det H(t, xo) = exp a V - f£(7(s)) ds 
0 


where y(t) = $,(xo) is a periodic solution of (1); cf. Problem 5 in 
Section 2.3 of Chapter 2. 


7. (a) Suppose that the linearization of (1) about a periodic orbit T' of 
(1) has a fundamental matrix solution given by 


cost —sint 0 0 0 
sint cost 0 0 0 
4et — e-2t 2(e~2¢ = et) 
t_ -2t —2t ot 
0 0 2(e°-—e~“*) de e 
3 3 
0 0 0 0 1 


Find the characteristic exponents of the periodic orbit I and the 
dimensions of W*([), W*“(T) and W°(L). 
(b) Same thing for 


e~**cos2t -e~**sin2t O O 0 
e~**sin2t e**cos2t 0 0 0 

&(t) = 0 0 et 0 Of. 
0 0 te? et 
0 0 0 0 1 


8. Consider the nonlinear system 
& = —2y + axr(4 — 42? — y? + z) 
y = 82 + ay(4 — 42? — y* + z) 
z = z(r — a’) 


where a is a parameter. Show that -y(t) = (cos4t,2sin4t,0)7 is a 
periodic solution of this system of period T = 2/2. Determine the 
linearization of this system about the periodic orbit +/(t), 


x = A(t)x, 
and show that 
e 82t cos 4t -5 sin4t a(t)e"? ttt sinat 


P(t) = |oe-8at sin at cos dt B(t)e~2 t+ 4 sin at 
0 0 eo t+4 sin 4t 
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is the fundamental matrix for this nonautonomous linear system 
which satisfies (0) = J, where a(t) and @(t) are 7/2-periodic func- 
tions which satisfy the nonhomogeneous linear system 


@\ _ [a(a — 4) — cos 4t — 4acos 8t —2 — 2asin 8t 
B) 8 — 8asin 8t a(a — 4) — cos 4t + 4acos 8t 


a acos 4t 
(5) a pmoweh 

and the initial conditions a(0) = 6(0) = 0. (This latter system can be 
solved using Theorem 1 and Remark 1 in Section 1.10 of Chapter 1 
and the result of Problem 4 in Section 2.2 of Chapter 2; however, 
this is not necessary for our purposes.) Write (t) in the form of 
equation (3), show that the characteristic exponents A; = —8a and 
2 = —a?, determine the characteristic multipliers of y(t), and de- 
termine the dimensions of the stable and unstable manifolds of -y(t) 
for a > 0 and for a < 0. 


3.6 Hamiltonian Systems with Two-Degrees of 
Freedom 


Just as the Hamiltonian systems with one-degree of freedom offered some 
interesting examples which illustrated the general theory developed in 
Chapter 2, Hamiltonian systems with two-degrees of freedom give us some 
interesting examples which further illustrate the nature of the invariant 
manifolds W*([), W*([) and W°(L), of a periodic orbit [’, discussed in 
this chapter. Before presenting these examples, we first show how projective 
geometry can be used to project the flow on an n-dimensional manifold in 
R"*+! onto a flow in R”. We begin with a simple example where we project 
the unit sphere S? = {x € R? | |x| = 1} in R® onto the (X, Y)-plane as 
indicated in Figure 1. 

It follows from the similar triangles shown in Figure 2 that the equations 
defining (X,Y) in terms of (z,y, z) are given by 


zt y 
or 1-2’ BS l-z 

These equations set up a one-to-one correspondence between points (z, y, z) 
on the unit sphere S? with the north pole deleted and points (X,Y) € 
R?. Points inside the circle X2 + Y? = 1 correspond to points on the 
lower hemisphere, the origin in the (X, Y)-plane corresponds to the point 
(0,0, —1), and points outside the circle X? + Y? = 1 correspond to points 
on the upper hemisphere; the point (0,0, 1) € S? corresponds to the “point 


3.6. Hamiltonian Systems with Two-Degrees of Freedom 235 


at infinity.” We can use this type of projective geometry to visualize flows 
on n-dimensional manifolds. The sphere in Figure 1 is referred to as the 
Bendixson sphere. 


Figure 1. Stereographic projection of S? onto the (X,Y)-plane. 


Figure 2. A cross-section of the sphere in Figure 1. 


Example 1. Consider the system 

&= —-y+ 22" 

y=oty2" 

ns a 29 

z= —-2z(z*+y"*). 
It is easy to see that for V(z,y,z) = x? + y? + z? we have V = 0 along 
trajectories of this system. Thus, trajectories lie on the spheres z? + y? + 
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z* = k?. The flow on any one of these spheres is topologically equivalent 
to the flow on the unit two-dimensional sphere S? shown in Figure 3. The 


ae 


Figure 3. A flow on the unit sphere S?. 


Figure 4. Various planar representations of the flow on S? shown in Fig- 
ure 3. 


flow on the equator of S? represents a periodic orbit 
Tr: y(t) = (cost, sin t,0)7. 


The periodic orbit ! has a two dimensional stable manifold W*(I') = S? ~ 
{(0,0,+1)}. If we project from the north pole of S? onto the (X, Y)-plane 
as in Figure 1, we obtain the flow in the (X, Y )-plane shown in Figure 4(a). 
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The periodic orbit [ gets mapped onto the unit circle. We cannot picture 
the flow in a neighborhood of the north pole (0,0,1) in the planar phase 
portrait in Figure 4(a); however, if we wish to picture the flow near (0,0, 1), 
we could project from the point (1,0,0) onto the (Y, Z)-plane and obtain 
the planar phase portrait shown in Figure 4(b). Note that the periodic 
orbit I gets mapped onto the Y-axis which is “connected at the point at 
infinity” in Figure 4(b). 

It can be shown that the periodic orbit [ has characteristic exponents 
Ai = Ao = 0 and A3 = —1; cf. Problem 1 in Section 3.5. Thus, I’ has 
a two-dimensional stable manifold W*(I') = S? ~ {0,0,+1)} and a two- 
dimensional center manifold W°(I) = {x € R? | z = 0}. Of course, we do 
not see the center manifold W‘(I) in either of the projections in Figure 4 
since we are only projecting the sphere S? onto R? in Figure 4. 


Example 2. We now consider the Hamiltonian system with two-degrees 
of freedom 


t=y 
y=-Z 
z=w 
w=-Zz 


with Hamiltonian H(z, y, z,w) = (x? +y? +z? + w?)/2. Trajectories of this 
system lie on the hyperspheres x? + y? + 2? + w? = k? and the flow on each 
hypersphere is topologically equivalent to the flow on the unit three-sphere 
S3 = {x € R‘ | |x| = 1}. On S°, the total energy H = 1/2 is divided 
between the two harmonic oscillators <+ z = 0 and z+ z = 0; i.e., it follows 
from the above equations that 


c+y*=h? and 224+ w*=1-h? (1) 
for some constant h € (0,1). There are two periodic orbits on S°, 
Ti: 7, (t) = (cost, — sint, 0,0)" 


and 
To: Yo(t) = (0,0, cost, —sint)7, 

corresponding to h = 1 and h = 0 respectively. If we project S? onto 
R? from the point (0,0,0,1) € S*, we obtain a one-to-one correspondence 
between points (zr, y,z,w) € S? ~ {(0,0,0,1)} and points (X,Y, Z) € R° 
given by F , : 

ca ET, eg ~~ l-w (2) 
If h = 1, then from (1), z = w = 0 and 22+ y? = X24 Y? = 1; ie., 
the periodic orbit I, gets mapped onto the unit circle X2 + Y? = 1 in the 
(X, Y)-plane in R?. And if h = 0, then from (1), z = y = 0 and 


Gite 
1% V1 — 22’ 
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i.e., the periodic orbit [9 gets mapped onto the Z-axis “connected at in- 
finity.” These two periodic orbits in (X,Y, Z)-space are shown in Figure 5. 
The remaining trajectories of this system lie on two-dimensional tori, T?, 
obtained as the cross product of two circles: 


Ty = {xe R4 [224+ y? =h?, 224+ w? =1-h?}. 


Figure 5. A flow on S® consisting of two periodic orbits and flows on 
invariant tori. 


The equations for the projections of these two-dimensional tori onto R? 
can be found by substituting (2) into (1). This yields 


2 
X24 Y= and Z7(1 — w)* + w? = 1—h?. 


Solving the second equation for w and substituting into the first equation 


yields : 
h(Z* + 1) 
VX24+ Y2 = ——_—___—__., 
1+ V1 — h? — h?2Z2 


In cylindrical coordinates (f,@,Z), this simplifies to the equations of the 
two-dimensional tori 


1\? 1h? 
T z+ (R- 5) =~ (3) 


i.e., the tori T? are obtained by rotating the circles in the (X, Z)-plane, 
centered at (1/h,0,0) with radius //1 — h2/h, about the Z-axis. These in- 
variant tori are shown in Figure 5. In this example, the periodic orbit [, 
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has a four-dimensional center manifold 


winj=US 
r>0 


where on each three-sphere S3 of radius r, [, has a three-dimensional center 
manifold as pictured in Figure 5. It can be shown that [, has four zero 
characteristic exponents; cf. Problem 1. 


Example 3. Consider the Hamiltonian system 


T=y 
y=-z 
z=-2z 
w=w 


with Hamiltonian H(z, y,z,w) = (z? + y*)/2 — zw. Trajectories of this 
system lie on the three-dimensional hypersurfaces 


S: 22 + y? —Qwz =k. 


The flow on each of these hypersurfaces is topologically equivalent to the 
flow on the hypersurface x? + y? — 2wz = 1. On this hypersurface there is 
a periodic orbit 


Tr: y(t) = (cost, —sint,0,0)7. 


The linearization of this system about -y(t) is given by 


01 0 
-1 0 00 
x= x. 
00 -1 0 
00 01 


The fundamental matrix for this linear system satisfying ®(0) = J is given 


by 
&(t) = a 7 eBt 


where R; is a rotation matrix and B = diag(0,0, —1, 1]. The characteristic 
exponents A, = Az = 0, A3 = —1 and 4 = 1, and the periodic orbit I has 
a two-dimensional stable manifold W*(IT) and a two-dimensional unstable 
manifold W“(T) on S, as well as a two-dimensional center manifold W°(T) 
(which does not lie on S). If we project the hypersurface S from the point 
(1,0,0,0) € S onto R3, the periodic orbit [ gets mapped onto the Y-axis; 
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W°(I) is mapped onto the (Y, Z)-plane and W“(I) is mapped onto the 
(Y, W)-plane; cf. Figure 6. 


Figure 6. The two-dimensional stable and unstable manifolds of the peri- 
odic orbit I. 


Example 4. Consider the pendulum oscillator 


r=y 
y= -Z 
z=w 
w= —sinz 


with Hamiltonian H(z, y, z,w) = (x? + y”)/2 + (1 — cosz) + w?/2. Trajec- 
tories of this system lie on the three-dimensional hypersurfaces 


S: 2? + y? + w? + 2(1 — cosz) = k?. 
For k > 2 there are three periodic orbits on the hypersurface S: 
To: Yo(t) = (kcost, —ksint, 0,0) 


ls: y(t) = (VK — 4cost, —V k? — 4sint, +n,0) 


If we project from the point (k,0,0,0) € S onto R3, the periodic orbit 
Io gets mapped onto the Y-axis and the periodic orbits [, get mapped 


onto the ellipses 
kn\? T\2 
2 —_ —} _— © 
nmY* +4 (z + 4 ) ( ) : 
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cf. Problem 3. Since 


1 0 0 
-1 0 0 0 

Df (x) = ’ 
0 0 1 


0 0 —cosz 0 


we find that ‘9 has all zero characteristic exponents. Thus Ip has a three- 
dimensional center manifold on S. Similarly, [+ have characteristic expo- 
nents A; = Az = 0, Az = 1 and Aq = —1. Thus, [4 have two-dimensional 
stable and unstable manifolds on S and two-dimensional center manifolds 
(which do not lie on S); cf. Figure 7. 


wi(P)=w(f) 


7 


8 M 
wip )swe(f) 


r, w°( f,) 


Figure 7. The flow of the pendulum-oscillator in projective space. 


We see that for Hamiltonian systems with two-degrees of freedom, the 
trajectories of the system lie on three-dimensional hypersurfaces S given 
by H(x) = constant. At any point x9 € S there is a two-dimensional 
hypersurface © normal to the flow. If xo is a point on a periodic orbit then 
according to Theorem 1 in Section 3.4, there is an € > 0 and a Poincaré 
map 


P: N. (xo) NZ — XZ. 


Furthermore, we see that (i) a fixed point of P corresponds to a periodic 
orbit I’ of the system, (ii) if the iterates of P lie on a smooth curve, then 
this smooth curve is the cross-section of an invariant differentiable manifold 
of the system such as W°([) or W%(L), and (iii) if the iterates of P lie on 
a closed curve, then this closed curve is the cross-section of an invariant 
torus of the system belonging to W‘°(I); cf. [(G/H], pp. 212-216. 
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PROBLEM SET 6 


1. Show that the fundamental matrix for the linearization of the system 
in Example 2 about the periodic orbit I, which satisfies ®(0) = J is 
equal to 


w= [a 


where R; is the rotation matrix 


cost sint 
Ry = b sint ea 


Thus ®(t) can be written in the form of equation (3) in Section 3.5 
with B = 0. What does this tell you about the dimension of the center 
manifold W°(I)? Carry out the details in obtaining equation (3) for 
the invariant tori T?. 


2. Consider the Hamiltonian system with two-degrees of freedom 


z= By 
y = —Bx 
z=w 

= 2 


with G > 0. 


(a) Show that for H = 1/2, the trajectories of this system lie on the 
three-dimensional ellipsoid 


S: Biz? +y*?)+2274+w? =1 


and furthermore that for each h € (0,1) the trajectories lie on 
two-dimensional invariant tori 


T? = {xe R*|2? 4+y? =h?/G,22+w? =1-h?} CS. 


(b) Use the projection of S onto R® given by equation (2) to show 


that these invariant tori are given by rotating the ellipsoids 


1 \*? 1-h? 
2 cae ere aes 
z+8(x +775) 3 


~~ 


about the Z-axis. 


(c) Show that the flow is dense in each invariant tori, T/, if @ is 
irrational and that it consists of a one-parameter family of pe- 
riodic orbits which lie on T? if 3 is rational; cf. Problem 2 in 
Section 3.2. 
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3. In Example 4, use the projective transformation 


sy _ 2 __w 
i= k-—2’ a k-2’ ms k-2z 
and show that the periodic orbit 
l',: y(t) = (cost, — sin t, 7, 0) 


gets mapped onto the ellipse 


mY? +4 2)’ = ( 
4 


4. Show that the Hamiltonian system 


r=y 
y=-2 
z=w 
oe 2 
w>=-z+2Z 


with Hamiltonian H(z, y,z,w) = (2? + y* + 2? + w?)/2 — z3/3 has 
two periodic orbits 


To: Yo(t) = (kcost, —k sin t, 0,0) 


Ty: ¥,(¢) = (Ve — 1/3cost, —/k? — 1/3sint, 1,0) 


which lie on the surface x? + y? + w? + z? — 223 = k? for k? > 1/3. 
Show that under the projective transformation defined in Problem 3, 
Io gets mapped onto the Y-axis and I’; gets mapped onto an ellipse. 
Show that Ip has four zero characteristic exponents and that I’; has 
characteristic exponents A; = Az = 0, Az = 1 and A4 = —1. Sketch a 
local phrase portrait for this system in the projective space including 
Io and I; and parts of the invariant manifolds W°(T9), W*(['1) and 
W*(T}). 


5. Carry out the same sort of analysis as in Problem 4 for the Duffing- 
oscillator with Hamiltonian 


H(z, y, z,w) = (x? + y? — z* — w?)/2 + 24/4, 
and periodic orbits 


To: Yo(t) = (kcost, —ksin t, 0,0) 


Ps: 7,(t) = (Ve — 1/4 cost, \/k? — 1/4sint, +1,0) 
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6. Define an atlas for S? by using the stereographic projections onto 
R? from the north pole (0,0,1) of S?, as in Figure 1, and from the 
south pole (0,0, —1) of S?; i.e., let U; = R? and for (x,y,z) € S? ~ 
{(0,0,1)} define 


r 
h, (z, y, Z) = (=. 4) ‘ 


Similarly let U2 = R? and for (x,y,z) € S? ~ {(0,0, —1)} define 


ha(2,¥,2) = ( ea ane ). 


l+z’l+z 


Find hgoh;! (using Figures 1 and 2), find Dhgohy;!(X,Y) and show 
that det Dho o hy'(X,Y) # 0 for all (X,Y) € hy(U,; NU2). (Note 
that at least two charts are needed in any atlas for S?.) 


3.7 The Poincaré-Bendixson Theory in R? 


In section 3.2, we defined the a and w-limit sets of a trajectory [ and saw 
that they were closed invariant sets of the system 


We also saw in the examples of Sections 3.2 and 3.3 that the a or w-limit 
set of a trajectory could be a critical point, a limit cycle, a surface in R® or 
a strange attractor consisting of an infinite number of interleaved branched 
surfaces in R°. For two-dimensional analytic systems, (1) with x € R?, 
the a and w-limit sets of a trajectory are relatively simple objects: The 
a or w-limit set of any trajectory of a two-dimensional, relatively-prime, 
analytic system is either a critical point, a cycle, or a compound separatrix 
cycle. A compound separatrix cycle or graphic of (1) is a finite union of 
compatibly oriented separatrix cycles of (1). Several examples of graphics 
were given in Section 3.3. 

Let us first give a precise definition of separatrix cycles and graphics of 
(1) and then state and prove the main theorems in the Poincaré-Bendixson 
theory for planar dynamical systems. This theory originated with Henri 
Poincaré {P] and Ivar Bendixson [B] at the turn of the century. Recall that 
in Section 2.11 of Chapter 2 we defined a separatrix as a trajectory of (1) 
which lies on the boundary of a hyperbolic sector of (1). A more precise 
definition of a separatrix is given in Section 3.11. 


Definition 1. A separatriz cycle of (1), S, is a continuous image of a 
circle which consists of the union of a finite number of critical points and 
compatibly oriented separatrices of (1), p;,Tj, 7 = 1,...,m, such that 
for j = 1,...,m, a([j;) = p; and w(T;) = pj41 where pm41 = pi. A 
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compound separatriz cycle or graphic of (1), S, is the union of a finite 
number of compatibly oriented separatrix cycles of (1). 

In the proof of the generalized Poincaré-Bendixson theorem for analytic 
systems given below, it is shown that if a graphic S is the limit set of a 
trajectory of (1) then the Poincaré map is defined on at least one side of S. 
The fact that the Poincaré map is defined on one side of a graphic S of (1) 
implies that for each separatrix [; € S, at least one of the sectors adjacent 
to I’; is a hyperbolic sector; it also implies that all of the separatrix cycles 
contained in S are compatibly oriented. 


Theorem 1 (The Poincaré—Bendixson Theorem). Suppose that f € 
C1(E) where E is an open subset of R? and that (1) has a trajectory T 
with T'* contained in a compact subset F of E. Then if w(T) contains no 
critical point of (1), w([) is a periodic orbit of (1). 


Theorem 2 (The Generalized Poincaré—Bendixson Theorem). 
Under the hypotheses of Theorem 1 and the assumption that (1) has only a 
finite number of critical points in F, it follows that w(T) is either a critical 
point of (1), a periodic orbit of (1), or that w(I) consists of a finite number 
of critical points, p,,...,Pm, Of (1) and a countable number of limit orbits 
of (1) whose a andw limit sets belong to {pi,..., Pm}. 


This theorem is proved on pp. 15-18 in [P/d] and, except for the finiteness 
of the number of limit orbits, it also follows as in the proof of the generalized 
Poincaré-Bendixson theorem for analytic systems given below. On p. 19 in 
[P/d] it is noted that the w-limit set, w(I'), may consist of a “rose”; i.e., 
a single critical point p;, with a countable number of petals, consisting of 
elliptic sectors, whose boundaries are homoclinic loops at p,. In general, 
this theorem shows that w(I) is either a single critical point of (1), a limit 
cycle of (1), or that w(I) consists of a finite number of critical points 
P1,---,Pm, of (1) connected by a finite number of compatibly oriented 
limit orbits of (1) together with a finite number of “roses” at some of the 
critical points p),..., Pm. Note that it follows from Lemma 1.7 in Chapter 1 
of [P/d] that if p, and po are distinct critical points of (1) which belong to 
the w-limit set w(I), then there exists at most one limit orbit [) C w(T) 
such that a([,) = p; and w(T)) = pe. For analytic or polynomial systems, 
w(I) is somewhat simpler. In particular, it follows from Theorem VIII on 
p. 31 of [B] that any rose of an analytic system has only a finite number of 
petals. 


Theorem 3 (The Generalized Poincaré—Bendixson Theorem for 
Analytic Systems). Suppose that (1) is a relatively prime analytic system 
in an open set E of R? and that (1) has a trajectory with T+ contained 
in a compact subset F of E. Then it follows that w(I) is either a critical 
point of (1), a periodic orbit of (1), or a graphic of (1). 
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Remark 1. It is well known that any relatively-prime analytic system (1) 
has at most a finite number of critical points in any bounded region of 
the plane; cf. (B], p. 30. The author has recently published a proof of this 
statement since it is difficult to find in the literature; cf. [24]. Also, it is 
important to note that under the hypotheses of the above theorems with 
I~ in place of [*+, the same conclusions hold for the a-limit set of [', a(I), 
as for the w-limit set of I. 

Furthermore, the above theorem, describing the a and w-limit sets of 
trajectories of relatively-prime, analytic systems on compact subsets of R?, 
can be extended to all of R2 if we include graphics which contain the point 
at infinity on the Bendixson sphere (described in Figure 1 of Section 3.6); cf. 
Remark 3 and Theorem 4 below. In this regard, we note that any trajectory, 
x(t), of a planar analytic system either (i) is bounded (if |x(t)| < M for 
some constant M and for all t € R) or (ii) escapes to infinity (if |x(t)| — 00 
as t —> +00) or (iii) is an unbounded oscillation (if neither (i) nor (ii) hold). 
And it is exactly when x(t) is an unbounded oscillation that either the a 
or the w-limit set of x(t) is a graphic containing the point at infinity on 
the Bendixon sphere. Cf. Problem 8. 

The proofs of the above theorems follow from the lemmas established 
below. We first define what is meant by a transversal for (1). 


Definition 2. A finite closed segment of a straight line, 2, contained in E, 
is called a transversal for (1) if there are no critical points of (1) on @ and 
if the vector field defined by (1) is not tangent to @ at any point of @. A 
point Xo in E£ is a regular point of (1) if it is not a critical point of (1). 


Lemma 1. Every regular point xo in E is an interior point of some trans- 
versal €. Every trajectory which intersects a transversal € at a point xo 
must cross it. Let Xo be an interior point of a transversal €; then for all 
€ > 0 there is a6 >0 such that every trajectory passing through a point in 
N6(xXo) at t = 0 crosses @ at some time t with |t| < «. 


Proof. The first statement follows from the definition of a regular point xo 
by taking @ to be the straight line perpendicular to the vector defined by 
f(x9) at x9. The second statement follows from the fundamental existence- 
uniqueness theorem in Section 2.2 of Chapter 2 by taking x(0) = x9; i.e., the 
solution x(t), with x(0) = xo defined for —a < t < a, defines a curve which 
crosses @ at Xo. In order to establish the last statement, let x = (z,y)7, 
let xo = (Zo, yo)7, and let @ be the straight line given by the equation 
az + by +c = 0 with azo + byo + c = 0. Then since Xp is a regular point 
of (1), there exists a neighborhood of x9, N(x), containing only regular 
points of (1). This follows from the continuity of f. The solution x(t, €,7) 
passing through a point (€,7) € N(xo) at t = 0 is continuous in (¢, €,7); 
cf. Section 2.3 in Chapter 2. Let 


L(t, €,n) = az(t, €,n) + by(t, €,n) +. 
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Then L(0, zo, yo) = 0 and at any point (zo, yo) on @ 


x =azr+ by #0 
since @ is a transversal. Thus it follows from the implicit function theorem 
that there is a continuous function t(€,7) defined in some neighborhood of 
Xo such that t(zo, yo) = 0 and L(t(,), €,7) = 0 in that neighborhood. By 
continuity, for « > 0 there exists a 6 > 0 such that for all (€,7) € Ng(xo) we 
have |t(€,7)| < ¢«. Thus the trajectory through any point (€,7) € Nos(xo) 
at t = 0 will cross the transversal @ at time t = t(€,7) where |t(€,7)| < e. 


Lemma 2. If a finite closed arc of any trajectory I’ intersects a transversal 
é, it does so in a finite number of points. If is a periodic orbit, it intersects 
é in only one point. 

Proof. Let the trajectory f = {x € E | x = x(t),t € R} where x(t) is 
a solution of (1), and let A be the finite closed arc A = {x € E| x = 
x(t),a <t < b}. If A meets 2 in infinitely many distinct points x, = x(t,), 
then the sequence ft, will have a limit point ¢* € [a,b]. Thus, there is a 
subsequence, call it t,, such that t, — t*. Then x(t,) —- y = x(t*) € @ as 
n — oo. But ; m 

Un) AE), (er) = £(x(£°)) 
i 
as n — oo. And since tp, t* € [a.b] and x(t,), x(t*) € @, it follows that 


x(tn) — x(t") 


Vv, 
tn pe fag 


x, 


(a) (b) 


Figure 1. A Jordan curve defined by I and @. 


a vector tangent to @ at y, as n — oo. This is a contradiction since @ is a 
transversal of (1). Thus, A meets @ in at most a finite number of points. 


248 3. Nonlinear Systems: Global Theory 


Now let x; = x(t,) and x2 = x(t2) be two successive points of intersec- 
tion of A with 2 and assume that t; < tg. Suppose that x, is distinct from 
x2. Then the arc Ajp = {x € R? | x = x(t),t) < t < to} together with 
the closed segment X1X2 of 2 comprises a Jordan curve J which separates 
the plane into two regions: cf. Figure 1. Then points q = x(t) on I with 
t < t, (and near ¢,) will be on the opposite side of J from points p = x(t) 
with ¢ > tg (and near t2). Suppose that p is inside J as in Figure l(a). 
Then to have [ outside J for t > te, I must cross J. But [I cannot cross 
Aj2 by the uniqueness theorem and I cannot cross X;X2 C @ since the flow 
is inward on X;X2; otherwise, there would be a point on the segment X] x2 
tangent to the vector field (1). Hence, I remains inside J for all t > to. 
Therefore, cannot be periodic. A similar argument for p outside J as in 
Figure 1(b) also shows that I cannot be periodic. Thus, if I is a periodic 
orbit, it cannot meet @ in two or more points. 


Remark 2. This same argument can be used to show that w(I) intersects 
é in only one point. 


Lemma 3. /f [ and w(T) have a point in common, then T is either a 
critical point or a periodic orbit. 


Proof. Let x; = x(t,;) € [TNw(L). If x; is a critical point of (1) then 
x(t) = x, for all ¢ € R. If x, is a regular point of (1), then, by Lemma 1, 
it is an interior point of a transversal @ of (1). Since x; € w(I), it follows 
from the definition of the w-limit set of [ that any circle C with x, as 
center must contain in its interior a point x = x(t*) with t* > ¢,; +2. IfC 
is the circle with € = 1 in Lemma 1, then there is an x2 = x(t2) € I where 
|tg — t*| < 1 and x2 € @. Assume that x2 is distinct from x,. Then the arc 
XX of I intersects 2 in a finite number of points by Lemma 2. Also, the 
successive intersections of with 2 form a monotone sequence which tends 
away from x,. Hence, x, cannot be an w-limit point of I’, a contradiction. 
Thus, x; = X2 and [ is a periodic orbit of (1). 


Lemma 4. Ifw(I) contains no critical points and w(T) contains a periodic 
orbit Io, then w(T) = To. 

Proof. Let [9 C w(I) be a periodic orbit with [9 # w(I). Then, by the 
connectedness of w(I) in Theorem 1 of Section 3.2, [9 contains a limit 
point yo of the set w([) ~ Io; otherwise, we could separate the sets Io 
and w(I') ~ [9 by open sets and this would contradict the connectedness 
of w(I). Let 2 be a transversal through yo. Then it follows from the fact 
that yo is a limit point of w([) ~ [9 that every circle with yo as center 
contains a point y of w([) ~[9; and, by Lemma 1, for y sufficiently close 
to yo, the trajectory [, through the point y will cross @ at a point y;. Since 
y € w(L) ~Tp is a regular point of (1), the trajectory I is a limit orbit of 
(1) which is distinct from [9 since [ C w(T) ~ To. Hence, 2 contains two 
distinct points yo € To C w(T) and y,; € [ C w(L). But this contradicts 
Remark 2. Thus Io = w(I). 
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Proof (of the Poincaré—Bendixson Theorem). If I is a periodic orbit, 
then [ ¢c w(I) and by Lemma 4, [ = w(L). If [ is not a periodic orbit, 
then since w(I) is nonempty and consists of regular points only, there is a 
limit orbit [9 of P such that 9 C w(I). Since ['* is contained in a compact 
set F Cc E, the limit orbit [9 C F. Thus [Fp has an w-limit point yo and 
Yo € w(I) since w(T) is closed. If @ is a transversal through yo, then, since 
Io and yo are both in w(I), @ can intersect w(T) only at yo according to 
Remark 2. Since yo is a limit point of Io, it follows from Lemma 1 that @ 
must intersect [9 in some point which, according to Lemma 2, must be yo. 
Hence Ip and w(I9) have the point yo in common. Thus, by Lemma 3, Ip 
is a periodic orbit; and, by Lemma 4, [9 = w (I). 


Proof (of the Generalized Poincaré-Bendixson Theorem for An- 
alytic Systems). By hypothesis, w(I) contains at most a finite number 
of critical points of (1) and they are isolated. (i) If w(I') contains no reg- 
ular points of (1) then w(I[') = Xo, a critical point of (1), since w(I) is 
connected. (ii) If w(I’) consists entirely of regular points, then either I is a 
periodic orbit, in which case [! = w(I), or w(I) is a periodic orbit by the 
Poincaré-Bendixson Theorem. (iii) If w(I’) consists of both regular points 
and a finite number of critical points, then w(T) consists of limit orbits and 
critical points. Let [9 C w(I) be a limit orbit. Then, as in the proof of the 
Poincaré—-Bendixson Theorem, [9 cannot have a regular w-limit point; if it 
did, we would have w(IT) = [p, a periodic orbit, and w(I) would contain no 
critical points. Thus, each limit orbit in w(I) has one of the critical points 
in w(I) at its w-limit set since w(I) is connected. Similarly, each limit orbit 
in w(T) has one of the critical points in w(I) as its a-limit set. Thus, with 
an appropriate ordering of the critical points p;, 7 = 1,...,m (which may 
not be distinct) and the limit orbits ; C w(T), j =1,...,m, we have 
a(Pj)=p; and w(P;) = pj4i 

for 7 = 1,...,m, where pm41 = Pp). The finiteness of the number of limit 
orbits, [',, follows from Theorems VIII and IX in [B] and Lemma 1.7 in 
[P/d]. And since w(T) consists of limit orbits, [;, and their a and w-limit 
sets, p;, it follows that the trajectory I either spirals down to or out toward 
w(I) as t — oo; cf. Theorem 3.2 on p. 396 in (C/L]. Therefore, as in 
Theorem 1 in Section 3.4, we can construct the Poincaré map at any point 
p sufficiently close to w(I) which is either in the exterior of w(I) or in 
the interior of one of the components of w(I) respectively; i.e., w(T) is a 
graphic of (1) and we say that the Poincaré map is defined on one side 
of w(I). This completes the proof of the generalized Poincaré—Bendixson 
Theorem. 

We next present a version of the generalized Poincaré-Bendixson theorem 
for flows on compact, two-dimensional manifolds (defined in Section 3.10); 
cf. Proposition 2.3 in Chapter 4 of [P/d]. In order to present this result, it 
is first necessary to define what we mean by a recurrent motion or recurrent 
trajectory. 
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Definition 3. Let I’ be a trajectory of (1). Then TI is recurrent if [! Cc a(T) 
or ! c w(l). A recurrent trajectory or orbit is called trivial if it is either a 
critical point or a periodic orbit of (1). 


We note that critical points and periodic orbits of (1) are always trivial 
recurrent orbits of (1) and that for planar flows (or flows on S?) these are 
the only recurrent orbits; however, flows on other two-dimensional surfaces 
can have more complicated recurrent motions. For example, every trajec- 
tory I of the irrational flow on the torus, T?, described in Problem 2 of 
Section 3.2, is recurrent and nontrivial and its w-limit limit set w(I') = T?. 
The Cherry flow, described in Example 13 on p. 137 in [P/d], gives us an 
example of an analytic flow on T? which has one source and one saddle, 
the unstable separatrices of the saddle being nontrivial recurrent trajec- 
tories which intersect a transversal to the flow in a Cantor set. Also, we 
can construct vector fields with nontrivial recurrent motions on any two- 
dimensional, compact manifold except for the sphere, the projective plane 
and the Klein bottle. The fact that all recurrent motions are trivial on the 
sphere and on the projective plane follows from the Poincaré—Bendixson 
theorem and it was proved in 1969 by Markley [54] for the Klein bottle. 


Theorem 4 (The Poincaré—Bendixson Theorem for Two-Dimen- 
sional Manifolds). Let M be a compact two-dimensional manifold of 
class C? and let @, be the flow defined by a C! vector field on M which 
has only a finite number of critical points. If all recurrent orbits are trivial, 
then the w-limit set of any trajectory, 


y= {xe M|x= ¢,(xo),x0 € M,t € R} 


is either (i) an equilibrium point of @,, i.e., a point x9 € M such that 
, (x0) = Xo for all t € R; (ii) a periodic orbit, i.e., a trajectory 


Tp = {x € M| x= ,(x0),X0 € M,0 < t < T, 67(X0) = Xo}; 


or (iii) w(T) consists of a finite number of equilibrium points p,,...,Pm, of 
@, and a countable number of limit orbits whose a and w limit sets belong 
to {pi,..-,;Pm}- 


Remark 3. Suppose that @, is the flow defined by a relatively-prime, 
analytic vector field on an analytic compact, two-dimensional manifold M; 
then if ¢, has only a finite number of equilibrium points on M and if all 
recurrent motions are trivial, it follows that w(I) is either (i) an equilibrium 
point of @,, (ii) a periodic orbit, or (iii) a graphic on M. 


We note that the w-limit set w(I) of a trajectory I‘ of a flow on the 
sphere, the projective plane, or the Klein bottle is always one of the types 
listed in Theorem 4 (or in Remark 3 for analytic flows), but that w(I) is 
generally more complicated for flows on other two-dimensional manifolds 
unless the recurrent motions are all trivial. 
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We cite one final theorem for periodic orbits of planar systems in this 
section. This theorem is proved for example on p. 252 in [H/S]. It can also 
be proved using index theory as is done in Section 3.12; cf. Corollary 2 in 
Section 3.12. 


Theorem 5. Suppose that f € C'(E) where E is an open subset of R? 
which contains a periodic orbit T of (1) as well as its interior U. Then U 
contains at least one critical point of (1). 


Remark 4. For quadratic systems (1) where the components of f(x) con- 
sist of quadratic polynomials, it can be shown that U is a convex region 
which contains exactly one critical point of (1). 


PROBLEM SET 7 


1. Consider the system 
z= —y+a2(r‘ — 3r? +1) 
y=at+y(r* — 3r? +1) 
where r? = x? + y?. 


(a) Show that 7 < 0 on the circle r = 1 and that 7 > 0 on the circle 
r = 2. Use the Poincaré-Bendixson Theorem and the fact that 
the only critical point of this system is at the origin to show that 
there is a periodic orbit in the annular region A, = {x € R? | 
1 < |x| < 2}. 

(b) Show that the origin is an unstable focus for this system and 
use the Poincaré-Bendixson Theorem to show that there is a 
periodic orbit in the annular region Az = {x € R? | 0 < |x| < 
1}. 


(c) Find the unstable and stable limit cycles of this system. 


2. (a) Use the Poincaré-Bendixson Theorem and the fact that the pla- 
nar system 


r=z-y-z2° y=rt+y-y 

has only the one critical point at the origin to show that this 
system has a periodic orbit in the annular region A = {x € R? | 
1 < |x| < V2}. Hint: Convert to polar coordinates and show 
that for all « > 0, * < 0 on the circle r = /2+.€ andr >0O 
on r = 1 —e; then use the Poincaré—Bendixson theorem to show 


that this implies that there is a limit cycle in 
A = {x € R?|1< |x| < v2}; 


and then show that no limit cycle can have a point in common 
with either one of the circles r = 1 or r = V2. 
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(b) Show that there is at least one stable limit cycle in A. (In fact, 
this system has exactly one limit cycle in A and it is stable. 
Cf. Problem 3 in Section 3.9.) This limit cycle and the annular 
region A are shown in Figure 2. 


an\ 
WY 


Figure 2. The limit cycle for Problem 2. 


3. Let f be a C! vector field in an open set E C R? containing an 
annular region A with a smooth boundary. Suppose that f has no 
zeros in A, the closure of A, and that f is transverse to the boundary 
of A, pointing inward. 


(a) Prove that A contains a periodic orbit. 


(b) Prove that if A contains a finite number of cycles, then A con- 
tains at least one stable limit cycle of (1). 


4. Let f be a C' vector field in an open set E C R? containing the 
closure of the annular region A = {x € R? | 1 < |x| < 2}. Suppose 
that f has no zeros on the boundary of A and that at each boundary 
point x € A, f (x) is tangent to the boundary of A. 


(a) Under the further assumption that A contains no critical points 
or periodic orbits of (1), sketch the possible phase portraits in 
A. (There are two topologically distinct phase portraits in A.) 


(b) Suppose that the boundary trajectories are oppositely oriented 
and that the flow defined by (1) preserves area. Show that A 
contains at least two critical points of the system (1). (This is 
reminiscent of Poincaré’s Theorem for area preserving mappings 
of an annulus; cf. p. 220 in [G/H]. Recall that the flow defined 
by a Hamiltonian system with one-degree of freedom preserves 
area; cf. Problem 12 in Section 2.14 of Chapter 2.) 
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5. Show that 
t=y yo-rt+(l1-2?-y’)y 


has a unique stable limit cycle which is the w-limit set of every tra- 
jectory except the critical point at the origin. Hint: Compute 7. 


6. (a) Let Io be a periodic orbit of a C! dynamical system on an open 
set E Cc R? withT C E. Let Tp be the period of 9 and suppose 
that there is a sequence of periodic orbits [,, C E of periods T,, 
containing points x, which approach Xo € Ip as n — oo. Prove 
that 7, — Jo. Hint: Use Lemma 2 to show that the function 
T(x) of Theorem 1 in Section 3.4 satisfies r(x,) = T, for n 
sufficiently large. 


(b 


wee 


This result does not hold for higher dimensional systems. It is 
true, however, that if T, — T, then T is a multiple of To. Sketch 
a periodic orbit 9 in R? and one neighboring orbit I’, of period 
T, where for x, € I, we have r(x,) = T;,/2. 


7. Show that the C!-system ¢ = 2—rz—ry+zy,y=y-rytrz—2? 
can be written in polar coordinates as 7 = r(1 —1r), 6 = r(1 — cos@). 
Show that it has an unstable node at the origin and a saddle node at 
(1,0). Use this information and the Poincaré-Bendixson Theorem to 
sketch the phase portrait for this system and then deduce that for all 
x £0, o,(x) — (1,0) as t — o0, but that (1,0) is not stable. 


8. Show that the analytic system 


boy i= (74a -2|a+n 


has an unbounded oscillation and that the w-limit set of any tra- 
jectory starting on the positive y-axis is the invariant line y = —1. 
Sketch the phase portrait for this system on R? and on the Bendix- 
son sphere. Hint: Show that the line y = —1 is a trajectory of this 
system, that the only critical point is an unstable focus at the origin 
and that trajectories in the half plane y < —1 escape to infinity along 
parabolas y = yo — 7/2 as t + +00, i.e., show that au = 4-2 
as y — —OO. 


3.8 Lienard Systems 


In the previous section we saw that the Poincaré-Bendixson Theorem could 
be used to establish the existence of limit cycles for certain planar systems. 
It is a far more delicate question to determine the exact number of limit 
cycles of a certain system or class of systems depending on parameters. In 
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this section we present a proof of a classical result on the uniqueness of the 
limit cycle for systems of the form 


z=y- F(z) 
y = —g(z) (1) 


under certain conditions on the functions F and g. This result was first 
established by the French physicist A. Lienard in 1928 and the system (1) is 
referred to as a Lienard system. Lienard studied this system in the different, 
but equivalent form 

E+ f(z)z + 9(z) =0 


where f(z) = F’(z) in a paper on sustained oscillations. This second-order 
differential equation includes the famous van der Pol equation 


£+ p(x? -1l)t+2=0 (2) 


of vacuum-tube circuit theory as a special case. 

We present several other interesting results on the number of limit cy- 
cles of Lienard systems and polynomial systems in this section which we 
conclude with a brief discussion of Hilbert’s 16th Problem for planar poly- 
nomial systems. In the proof of Lienard’s Theorem and in the statements 
of some of the other theorems in this section it will be useful to define the 
functions 


F(z) = : fide and Cae [ " ale)ds 


and the energy function 
y? 
u(z,y) = 2 + G(r). 


Theorem 1 (Lienard’s Theorem). Under the assumptions that F,g € 
C'(R), F and g are odd functions of z, xg(r) > 0 for x #0, F(0) = 0, 
F'(0) < 0, F has single positive zero at r =a, and F increases monotoni- 
cally to infinity for x > a as x — 00, it follows that the Lienard system (1) 
has exactly one limit cycle and it is stable. 


The proof of this theorem makes use of the diagram below where the 
points P; have coordinates (z;,y;) for 7 = 0,1,...,4 and I is a trajectory 
of the Lienard system (1). The function F(z) shown in Figure 1 is typical 
of functions which satisfy the hypotheses of Theorem 1. Before presenting 
the proof of this theorem, we first of all make some simple observations: 
Under the assumptions of the above theorem, the origin is the only critical 
point of (1); the flow on the positive y-axis is horizontal and to the right, 
and the flow on the negative y-axis is horizontal and to the left; the flow 
on the curve y = F(z) is vertical, downward for z > 0 and upward for 
xz < 0; the system (1) is invariant under (z,y) — (—z,—y) and therefore 
if (z(t), y(t)) describes a trajectory of (1) so does (—z(t), —y(t)); it follows 
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Figure 1. The function F(z) and a trajectory [ of Lienard’s system. 


that that if I is a closed trajectory of (1), i.e., a periodic orbit of (1), then 
I’ is symmetric with respect to the origin. 


Proof. Due to the nature of the flow on the y-axis and on the curve y = 
F(z), any trajectory [ starting at a point Po on the positive y-axis crosses 
the curve y = F(z) vertically at a point P and then it crosses the negative 
y-axis horizontally at a point P,4; cf. Theorem 1.1, p. 202 in [H]. 

Due to the symmetry of the equation (1), it follows that I is a closed 
trajectory of (1) if and only if y4 = —yo; and for u(z,y) = y?/2 + G(z), 
this is equivalent to u(0,y4) = u(0, yo). Now let A be the arc PoP, of the 
trajectory I and consider the function (a) defined by the line integral 


¢(a) = I du = u(0, y4) — u(0, yo) 


where a@ = 22, the abscissa of the point P). It follows that [ is a closed 
trajectory of (1) if and only if ¢(a@) = 0. We shall show that the function 
¢(a) has exactly one zero a = ao and that ap > a. First of all, note that 
along the trajectory [ 


du = g(x) dz + ydy = F(z) dy. 
And if a < a then both F(z) < 0 and dy = —g(xz) dt < 0. Therefore, 
(a) > 0; ie., u(0,y4) > u(0, yo). Hence, any trajectory [ which crosses 
the curve y = F(z) at a point P2 with 0 < z2 = a < a is not closed. 
Lemma. For a > a, ¢(a) is a monotone decreasing function which de- 


creases from the positive value @(a) to —co as a@ increases in the interval 
[a, 00). 
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For a > a, as in Figure 1, we split the arc A into three parts A, = PoP, 
Ag = P,P; and A3 = PP, and define the functions 


$1 (a) = | du, $2(a) = i du and ¢3(a) = I du. 
It follows that ¢(a) = ¢:(a) + ¢2(a@) + $3(a). Along [ we have 


du = [o(e) + FA dx 


ota) = Te dz 


y — F(z) 
_ —F(z)g(z) 
~ y= Fa) 


Along the arcs A, and Ag we have F(z) < 0, g(x) > 0 and dz/[y— F(z)| = 
dt > 0. Therefore, ¢,(a) > 0 and ¢3(a) > O. Similarly, along the arc 
Ag, we have F(x) > 0, g(x) > 0 and dx/[y — F(z)] = dt > 0 and therefore 
g2(a) < 0. Since trajectories of (1) do not cross, it follows that increasing a 
raises the arc A, and lowers the arc A3. Along A), the z-limits of integration 
remain fixed at zr = 29 = 0, and xz = 2, = a; and for each fixed z in 
(0,a], increasing a raises A, which increases y which in turn decreases 
the above integrand and therefore decreases ¢,(a). Along A3, the z-limits 
of integration remain fixed at 73 = a and z4 = 0; and for each fixed 
zx € (0,a], increasing a lowers A3 which decreases y which in turn decreases 
the magnitude of the above integrand and therefore decreases ¢3(a) since 


_ f -F(@)g(z) , _ [* | F(2)a(z) 
¢s(a) = f Fey = J, y — F(z) 


Along the arc Ag of [ we can write du = F(z) dy. And since trajectories 
of (1) do not cross, it follows that increasing a causes the arc Ag to move 
to the right. Along A2 the y-limits of integration remain fixed at y = y 
and y = y3; and for each fixed y € [y3, y:], increasing z increases F(z) and 
since 


Yi 
b(t) =—- | F(x) dy 
y3 
this in turn decreases ¢2(a). Hence for a > a, ¢ is a monotone decreasing 
function of a. It remains to show that ¢(a) —- —oo as a — oo. It suffices 
to show that ¢2(a) — —oo as a — oo. But along Ao, du = F(z) dy = 
—F(xz)g(x) dt < 0, and therefore for any sufficiently small « > 0 


yiweé 


Coie [Fwd " (2) dy > / "F(@) dy 
vl y3 ZTE 


yi-€ 
> F(e) / dy 
y 


3t+eé 
= F(e)[yi — y3 — 2¢] 
> F(e)[y: — 2e]. 
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But y, > yo and yz — oo as 22 = a — oo. Therefore, |¢2(a)| — 00 as 
a — 00; i.e., 2(a) 4 —00 as a > 00. 

Finally, since the continuous function ¢(a) decreases monotonically from 
the positive value ¢(a) to —oo as a increases in [a,0o), it follows that 
(a) = 0 at exactly one value of a, say a@ = ap, in (a,0o). Thus, (1) has 
exactly one closed trajectory 9 which goes through the point (ao, F(ao)). 
Furthermore, since ¢(a) < 0 for a > ao, it follows from the symmetry of the 
system (1) that for a # ao, successive points of intersection of trajectory [ 
through the point (a, F'(a)) with the y-axis approach Ip; i.e., 9 is a stable 
limit cycle of (1). This completes the proof of Lienard’s Theorem. 


Corollary. For 4 > 0, van der Pol’s equation (2) has a unique limit cycle 
and it is stable. 


Figure 2. The limit cycle for the van der Pol equation for u = 1 and p = .1. 


Figure 2 shows the limit cycle for the van der Pol equation (2) with » = 1 
and yu = .1. It can be shown that the limit cycle of (2) is asymptotic to the 
circle of radius 2 centered at the origin as yu — 0. 


Example 1. It is not difficult to show that the functions F(z) = (x? - 
x)/(x* + 1) and g(x) = z satisfy the hypotheses of Lienard’s Theorem; cf. 
Problem 1. It therefore follows that the system (1) with these functions has 
exactly one limit cycle which is stable. This limit cycle is shown in Figure 3. 


In 1958 the Chinese mathematician Zhang Zhifen proved the following 
useful result which complements Lienard’s Theorem. Cf. [35]. 


Theorem 2 (Zhang). Under the assumptions that a < 0 < b, Fig € 
C1(a,b), zg(x) > 0 for x # 0, G(x) — 00 as t > a if a = —00 and 
G(z) — 00 as x — b if b = 00, f(z)/g(x) is monotone increasing on 
(a,0) (0,5) and is not constant in any neighborhood of x = 0, it follows 
that the system (1) has at most one limit cycle in the regiona < x < b and 
if it exists it is stable. 
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Figure 3. The limit cycle for the Lienard system in Example 1. 


Figure 4. The limit cycle for the Lienard system in Example 2 with a = .02. 
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Example 2. The author recently used this theorem to show that for a € 
(0,1), the quadratic system 


z= -y(1+2)+azr+(a+1)z? 
y =2(1+72) 


has exactly one limit cycle and it is stable. It is easy to see that the flow 
is horizontal and to the right on the line z = —1. Therefore, any closed 
trajectory lies in the region x > —1. If we define a new independent variable 
7 by dr = —(1+ x)dt along trajectories x = x(t) of this system, it then 
takes the form of a Lienard system 


dr az + (a+1)z? 
dr 9 (i+z) 
dy 

dr 


Even though the hypotheses of Lienard’s Theorem are not satisfied, it can 
be shown that the hypotheses of Zhang’s theorem are satisfied. Therefore, 
this system has exactly one limit cycle and it is stable. The limit cycle for 
this system with a = .02 is shown in Figure 4. 


In 1981, Zhang proved another interesting theorem concerning the num- 
ber of limit cycles of the Lienard system (1). Cf. [36]. Also, cf. Theorem 7.1 


in [Y]. 

Theorem 3 (Zhang). Under the assumptions that g(x) = x, F € C'(R), 
f(x) is an even function with exactly two positive zeros a, < ag with 
F(a,) > 0 and F(az2) < 0, and f(x) ts monotone increasing for x > az, it 
follows that the system (1) has at most two limit cycles. 


Example 3. Consider the Lienard system (1) with g(z) = z and f(z) = 
1.624 — 4x? +.8. It is not difficult to show that the hypotheses of Theorem 3 
are satisfied; cf. Problem 2. It therefore follows that the system (1) with 
g(x) =z and F(z) = .322° — 4x°/3 + .8z has at most two limit cycles. In 
fact, this system has exactly two limit cycles (cf. Theorem 6 below) and 
they are shown in Figure 5. 


Of course, the more specific we are about the functions F(x) and g(z) 
in (1), the more specific we can be about the number of limit cycles that 
(1) has. For example, if g(x) = z and F(z) is a polynomial, we have the 
following results; cf. [18]. 


Theorem 4 (Lins, de Melo and Pugh). The system (1) with g(x) =z, 
F(x) = az + agz? + agzr*, and a,a3 < 0 has exactly one limit cycle. It is 
stable if a; <0 and unstable if a, > 0. 


Remark. The Russian mathematician Rychkov showed that the system (1) 
with g(x) = z and F(x) = a,x + a3x* + a3r° has at most two limit cycles. 
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Figure 5. The two limit cycle of the Lienard system in Example 3. 


In Section 3.4, we mentioned that m limit cycles can be made to bifurcate 
from a multiple focus of multiplicity m. This concept is discussed in some 
detail in Sections 4.4 and 4.5 of Chapter 4. Limit cycles which bifurcate 
from a multiple focus are called local limit cycles. The next theorem is 
proved in {3}. 


Theorem 5 (Blows and Lloyd). The system (1) with g(x) = zx and 
F(x) = a,x + agz? + +++ + Qam4it2"t! has at most m local limit cycles 
and there are coefficients with a,,a3,@5,...,@2m41 alternating in sign such 
that (1) has m local limit cycles. 


Theorem 6 (Perko). For « # 0 sufficiently small, the system (1) with 
g(x) = z and F(z) = eax +agz?+---+a2m4122"*"] has at most m limit 
cycles; furthermore, for « # 0 sufficiently small, this system has exactly 
m limit cycles which are asymptotic to circles of radius r,, j = 1,...,m, 
centered at the origin as € + 0 if and only if the mth degree equation 


Q) 3a3 Das, 2 35a7 3 2m +2 Q2m+1 om _ 
ott te? + tog? tt m41) pameze” =9 (3) 


has m positive roots p= r?, j =1,...,m. 


This last theorem is proved using Melnikov’s Method in Section 4.10. It 
is similar to Theorem 76 on p. 414 in [A-II]. 


Example 4. Theorem 6 allows us to construct polynomial systems with 
as many limit cycles as we like. For example, suppose that we wish to find a 
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Figure 6. The limit cycles of the Lienard system in Example 4 with e = .01. 


polynomial system of the form in Theorem 6 with exactly two limit cycles 
asymptotic to circles of radius r = 1 and r = 2. To do this, we simply set 
the polynomial (p — 1)(p — 4) equal to the polynomial in equation (3) with 
m = 2 in order to determine the coefficients a),a3 and as; i.e., we set 
5 3 1 
p — 5p +4 = rasp’ + Zasp + 541. 

This implies that as = 16/5, ag = —40/3 and a, = 8. For e # 0 sufficiently 
small, Theorem 6 then implies that the system 

& = y — €(82 — 40r°/3 + 162°/5) 

y=-z 
has exactly two limit cycles. For ¢ = .01 these limit cycles are shown in 
Figure 6. They are very near the circles r = 1 and r = 2. For e = .1 these 
two limit cycles are shown in Figure 5. They are no longer near the two 
circles r = 1 and r = 2 for this larger value of e«. Arbitrary even-degree 
terms such as aor? and a4z* may be added in the e-term in this system 


without affecting the results concerning the number and geometry of the 
limit cycles of this example. 


Example 5. As in Example 4, it can be shown that for e 4 0 sufficiently 
small, the Lienard system 

= y +e(72r — 392z°/3 + 2242°/5 — 1282’ /35) 

y=-2 
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has exactly three limit cycles which are asymptotic to the circles r = 1, 
r=2 andr =3 ase — 0; cf. Problem 3. The limit cycles for this system 
with € = .01 and € = .001 are shown in Figure 7. 


At the turn of the century, the world-famous mathematician David 
Hilbert presented a list of 23 outstanding mathematical problems to the 
Second International Congress of Mathematicians. The 16th Hilbert Prob- 
lem asks for a determination of the maximum number of limit cycles, H,, 
of an nth degree polynomial system 


n 
f= > a;;z'y? 
i+j=0 
bs . . 
b= DD byt’. (4) 
i+j=0 


For given (a,b) € R(+!)("+2) | let H,,(a,b) denote the number of limit 
cycles of the nth degree polynomial system (4) with coefficients (a, b). Note 
that Dulac’s Theorem asserts that H,,(a, b) < oo. The Hilbert number H,, 
is then equal to the sup H,,(a, b) over all (a,b) € RO*+H("+2)_ 

Since linear systems in R? do not have any limit cycles, cf. Section 1.5 
in Chapter 1, it follows that H,; = 0. However, even for the simplest class 
of nonlinear systems, (4) with n = 2, the Hilbert number H2 has not been 
determined. In 1962, the Russian mathematician N. V. Bautin (2] proved 
that any quadratic system, (4) with n = 2, has at most three local limit 
cycles. And for some time it was believed that H2 = 3. However, in 1979, 
the Chinese mathematicians S. L. Shi, L.S. Chen and M. S. Wang produced 
examples of quadratic systems with four limit cycles; cf. [29]. Hence Ha > 4. 
Based on all of the current evidence it is believed that Hz = 4 and in 1984, 
Y. X. Chin claimed to have proved this result; however, errors were pointed 
out in his work by Y. L. Cao. 


Figure 7. The limit cycles of the Lienard system in Example 5 with « = .01 
and ¢ = .001. 


3.8. Lienard Systems 263 


Regarding H3, it is known that a cubic system can have at least eleven 
local limit cycles; cf. [42]. Also, in 1983, J. B. Li et al. produced an example 
of a cubic system with eleven limit cycles. Thus, all that can be said at this 
time is that H3 > 11. Hilbert’s 16th Problem for planar polynomial systems 
has generated much interesting mathematical research in recent years and 
will probably continue to do so for some time. 


PROBLEM SET 8 


1. Show that the functions F(z) = (x°—2)/(z?+1) and g(x) = z satisfy 
the hypotheses of Lienard’s Theorem. 


2. Show that the functions f(r) = 1.624—4x?+.8 and F(xz)= fy f(s) ds= 
322° — 423 /3+.8x satisfy the hypotheses of Theorem 3. 


3. Set the polynomial (p — 1)(p — 4)(p — 9) equal to the polynomial in 
equation (3) with m = 3 and determine the coefficients a), a3,a5 and 
a7 in the system of Example 5. 


4. Construct a Lienard system with four limit cycles. 


5. (a) Determine the phase portrait for the system 


£=y-2? 


y= —-Z. 


(b) Determine the phase portrait for the Lienard system (1) with 
F,g € C!(R), F(z) an even function of z and g an odd function 
of x of the form g(x) = x + 0(z°). Hint: Cf. Theorem 6 in 
Section 2.10 of Chapter 2. 


6. Consider the van der Pol system 


é = y+ p(x — 2/3) 
y= —2. 


(a) As 4 — O* show that the limit cycle L, of this system ap- 
proaches the circle of radius two centered at the origin. 


(b) As 4 — oo show that the limit cycle L, is asymptotic to the 
closed curve consisting of two horizontal line segments on y = 
+2y/3 and two arcs of y = pp(z?/3 — x). To do this, let u = y/p 
and 7 = t/p and show that as p — oo the limit cycle of the 
resulting system approaches the closed curve consisting of the 
two horizontal line segments on u = +2/3 and the two arcs of 
the cubic u = x°/3 — x shown in Figure 8. 
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Figure 8. The limit of ZL, as zp — oo. 


7. Let F satisfy the hypotheses of Lienard’s Theorem. Show that 
z+ F(z)+z=0 


has a unique, asymptotically stable, periodic solution. 


Hint: Let 2 = z and y = —z. 


3.9 Bendixson’s Criteria 


Lienard’s Theorem and the other theorems in the previous section establish 
the existence of exactly one or exactly m limit cycles for certain planar 
systems. Bendixson’s Criteria and other theorems in this section establish 
conditions under which the planar system 


x = f(x) (1) 


with f = (P,Q)? and x = (z,y)? € R? has no limit cycles. In order 
to determine the global phase portrait of a planar dynamical system, it is 
necessary to determine the number of limit cycles around each critical point 
of the system. The theorems in this section and in the previous section make 
this possible for some planar systems. Unfortunately, it is generally not 
possible to determine the exact number of limit cycles of a planar system 
and this remains the single most difficult problem for planar systems. 


Theorem 1 (Bendixson’s Criteria). Let f € C'(E) where E is a sim- 
ply connected region in R?. If the divergence of the vector field £,V -f, is 
not identically zero and does not change sign in E, then (1) has no closed 
orbit lying entirely in E. 
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Proof. Suppose that T: x = x(t). 0 < t < T, is a closed orbit of (1) 
lying entirely in E. If S denotes the interior of I, it follows from Green’s 


Theorem that 
| |v tacdy = 9 (Pay - Qaz) 
S r 
T 


= | (Py - Qz) dt 
0 


And if V - f is not identically zero and does not change sign in S, then 
it follows from the continuity of V -f in S that the above double integral 
is either positive or negative. In either case this leads to a contradiction. 
Therefore, there is no closed orbit of (1) lying entirely in E. 


Remark 1. The same type of proof can be used to show that, under the 
hypotheses of Theorem 1, there is no separatrix cycle or graphic of (1) lying 
entirely in E; cf. Problem 1. And if V-f = 0 in E, it can be shown that, 
while there may be a center in E, i.e., a one-parameter family of cycles of 
(1), there is no limit cycle in E. 


A more general result of this type, which is also proved using Green’s 
Theorem, cf. Problem 2, is given by the following theorem: 


Theorem 2 (Dulac’s Criteria). Let f € C'(E) where E is a simply 
connected region in R?. If there exists a function B € C!(E) such that 
V -(Bf) is not identically zero and does not change sign in E, then (1) has 
no closed orbit lying entirely in E. If A is an annular region contained in 


E on which V - (Bf) does not change sign, then there is at most one limit 
cycle of (1) in A. 


As in the above remark, if V-(Bf) does not change sign in E, then it can 
be shown that there are no separatrix cycles or graphics of (1) in E and if 
V - (Bf) = 0 in E, then (1) may have a center in FE. Cf. [A-I], pp. 205-210. 
The next theorem, proved by the Russian mathematician L. Cherkas [5] 
in 1977, gives a set of conditions sufficient to guarantee that the Lienard 
system of Section 3.8 has no limit cycle. 


Theorem 3 (Cherkas). Assume that a < 0 < b, F,g € C'(a,b), and 
xrg(x) > 0 for x € (a,0) U(0,b). Then if the equations 

F(u) = F(v) 

G(u) = G(v) 


have no solutions with u € (a,0) and v € (0,b), the Lienard system (1) in 
Section 3.8 has no limit cycle in the regiona < x < b. 
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Corollary 1. If F,g € C'(R), g is an odd function of x and F is an odd 
function of x with its only zero at x = 0, then the Lienard system (1) in 
Section 3.8 has no limit cycles. 


Finally, we cite one other result, due to Cherkas [4], which is useful in 
showing the nonexistence of limit cycles for certain quadratic systems. 


Theorem 4. [fb <0, ac>0 andaa < 0, then the quadratic system 


z£=ax-—ytar? + bry +cy’ 
y=xrt+z" 


has no limit cycle around the origin. 


Example 1. Using this theorem, it is easy to show that for a € [-1,0], 
the quadratic system 


z£=ar—yt+(atl1)z? —zy 

y=rt+s? 
of Example 2 in Section 3.8 has no limit cycles. This follows since the 
origin is the only critical point of this system and therefore by Theorem 5 
in Section 3.7 any limit cycle of this system must enclose the origin. But 


according to the above theorem with b = —1 < 0, ac = O and aa = 
a(a+1) <0 for a € [—1,0], there is no limit cycle around the origin. 


PROBLEM SET 9 


1. Show that, under the hypotheses of Theorem 1, there is no separatrix 
cycle S lying entirely in E. Hint: If such a separatrix cycle exists, 
then S = j=, Tj where for j =1,...,m 


Dj: x =7,;(t), —-o0o<t<oo 
is a trajectory of (1). Apply Green’s Theorem. 


2. Use Green’s Theorem to prove Theorem 2. Hint: In proving the sec- 
ond part of that theorem, assume that there are two limit cycles [, 
and Iz in A, connect them with a smooth arc [9 (traversed in both 
directions), and then apply Green’s Theorem to the resulting simply 
connected region whose boundary is [) + Io — T'2 —To. 


3. (a) Show that for the system 


r=r—-y-xr° 


yarty-y 
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the divergence V -f < 0 in the annular region A = {x E R|1< 
|x| < V2} and yet there is a limit cycle in this region; cf. Prob- 
lem 2 in Section 3.7. Why doesn’t this contradict Bendixson’s 
Theorem? 


(b) Use the second part of Theorem 2 and the result of Problem 2 
in Section 3.7 to show that there is exactly one limit cycle in A. 


4. (a) Show that the limit cycle of the van der Pol equation 


t=y+2r—2°/3 


y= nz 
must cross the vertical lines = +1; cf. Figure 2 in Section 3.8. 


(b) Show that any limit cycle of the Lienard equation (1) in Sec- 
tion 3.8 with f and g odd C'-functions must cross the vertical 
line x = x, where 2 is the smallest zero of f(z). If equation (1) 
in Section 3.8 has a limit cycle, use the Corollary to Theorem 3 
to show that the function f(z) has at least one positive zero. 


5. (a) Use the Dulac function B(z,y) = be~?4* to show that the 
system 


r=y 
y = —ar — by + ax? + By? 
has no limit cycle in R?. 
(b) Show that the system 
a 
7 1422 
_ -e+y(1+2? +24) 
7 1+ 2? 


has no limit cycle in R?. 


3.10 The Poincaré Sphere and the Behavior at 
Infinity 


In order to study the behavior of the trajectories of a planar system for 
large r, we could use the stereographic projection defined in Section 3.6; 
cf. Figure 1 in Section 3.6. In that case, the behavior of trajectories far 
from the origin could be studied by considering the behavior of trajectories 
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near the “point at infinity,” i.e., near the north pole of the unit sphere in 
Figure 1 of Section 3.6. However, if this type of projection is used, the point 
at infinity is typically a very complicated critical point of the flow induced 
on the sphere and it is often difficult to analyze the flow in a neighborhood 
of this critical point. The idea of analyzing the global behavior of a planar 
dynamical system by using a stereographic projection of the sphere onto 
the plane is due to Bendixson [B]. The sphere, including the critical point 
at infinity, is referred to as the Bendixson sphere. 

A better approach to studying the behavior of trajectories “at infinity” is 
to use the so-called Poincaré sphere where we project from the center of the 
unit sphere S? = {(X,Y, Z) € R? | X2+Y?+4Z? = 1} onto the (z, y)-plane 
tangent to S? at either the north or south pole; cf. Figure 1. This type of 
central projection was introduced by Poincaré [P| and it has the advantage 
that the critical points at infinity are spread out along the equator of the 
Poincaré sphere and are therefore of a simpler nature than the critical point 
at infinity on the Bendixson sphere. However, some of the critical points at 
infinity on the Poincaré sphere may still be very complicated in nature. 


Figure 1. Central projection of the upper hemisphere of S? onto the 
(x, y)-plane. 


Remark. The method of “blowing-up” a neighborhood of a complicated 
critical point uses a combination of central and stereographic projections 
onto the Poincaré and Bendixson spheres respectively. It allows one to 
reduce the study of a complicated critical point at the origin to the study of 
a finite number of hyperbolic critical points on the equator of the Poincaré 
sphere. Cf. Problem 13. 


3.10. The Poincaré Sphere and the Behavior at Infinity 269 


Figure 2. A cross-section of the central projection of the upper hemisphere. 


If we project the upper hemisphere of S? onto the (zx, y)-plane, then it 
follows from the similar triangles shown in Figure 2 that the equations 
defining (z, y) in terms of (X,Y, Z) are given by 

X Y 
I= Zz y= Va (1) 
Similarly. it follows that the equations defining (X,Y, Z) in terms of (z, y) 
are given by 


pee, ye, 
Vl+2?4+y? JVl+a2?+y? Yl+a2?+y? 


These equations define a one-to-one correspondence between points 
(X,Y, Z) on the upper hemisphere of S? with Z > 0 and points (z, y) in the 
plane. The origin 0 € R? corresponds to the north pole (0,0, 1) € S?; points 
on the circle r? + y? = 1 correspond to points on the circle X?+ Y? = 1/2, 
Z = 1/V2 on S?; and points on the equator of S* correspond to the “cir- 
cle at infinity” or “points at infinity” of R?. Any two antipodal points 
(X.Y, Z) with (X’. Y’. Z’) on S?, but not on the equator of S?, correspond 
to the same point (z, y) € R?: cf. Figure 1. It is therefore only natural to 
regard any two antipodal points on the equator of S? as belonging to the 
same point at infinity. The hemisphere with the antipodal points on the 
equator identified is a model for the projective plane. However, rather than 
trying to visualize the flow on the projective plane induced by a dynamical 
system on R?, we shall visualize the flow on the Poincaré sphere induced 
by a dynamical system on R? where the flow in neighborhoods of antipodal 
points is topologically equivalent, except that the direction of the flow may 
be reversed. 


A= 
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Consider a flow defined by a dynamical system on R? 


z= P(z,y) 
i = Q(z,y) (2) 


where P and Q are polynomial functions of z and y. Let m denote the 
maximum degree of the terms in P and Q. This system can be written in 
the form of a single differential equation 

dy Q(z, y) 


dx P(z,y) 


or in differential form as 
Q(z, y) dx — P(z,y) dy = 0. (3) 


Note that in either of these two latter forms we lose the direction of the 
flow along the solution curves of (2). It follows from (1) that 


ZdX — X dZ ZdY —YdZ 
ee ger oe Cea (4) 


Thus, the differential equation (3) can be written as 


dx 


Q(Z dX — X dZ) — P(ZdY —YdZ)=0 
where 
P= P(z,y) = P(X/Z,Y/Z) 
and 
Q = Az, y) = Q(X/Z, Y/Z). 
In order to eliminate Z in the denominators, multiply the above equation 
through by Z™ to obtain 
ZQ* dX —- ZP* dY + (YP* — XQ") dZ =0 (5) 
where 
P*(X,Y,Z) = 2" P(X/Z,Y/Z) 
and 
Q°(X,Y,Z) = Z"Q(X/Z, Y/Z) 


are polynomials in (X,Y, Z). This equation can be written in the form of 
the determinant equation 


dX dY dZ 
X Y 2 
P* Q* 0O 


=0. (5') 
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Cf. [L], p. 202. The differential equation (5) then defines a family of solu- 
tion curves or a flow on S?. Each solution curve on the upper (or lower) 
hemisphere of S? defined by (5) corresponds to exactly one solution curve 
of the system (2) on R?. Furthermore, the flow on the Poincaré sphere S? 
defined by (5) allows us to study the behavior of the flow defined by (2) at 
infinity; i.e., we can study the flow defined by (5) in a neighborhood of the 
equator of S?. The equator of S? consists of trajectories and critical points 
of (5). This follows since for Z = 0 in (5) we have (Y P* — XQ*)dZ = 0. 
Thus, for YP* — XQ* # 0 we have dZ = 0; i.e., we have a trajectory 
through a regular point on the equator of S?. And the critical points of (5) 
on the equator of S? where Z = 0 are given by the equation 


YP* —-XQ* =0. (6) 
If 
P(z,y) = Pi(z,y) +--+ + Pm(z,y) 
and 
Q(z,y) = Qi(z,y) +--+ Qm(Z,y) 
where P; and Q,; are homogeneous jth degree polynomials in z and y, then 


Y P* — XQ* = Z™YP,(X/Z,Y/Z) +++ + Z™Y Pm(X/Z,Y/Z) 


— Z2™XQi(X/Z, Y/Z) — ++» - Z°XQm(X/Z, Y/Z) 
= Z™"'YP\(X,Y)+---+YPm(X,Y) 
— Z™'XQi(X,Y) —--» -—XQm(X,Y) 


= YPa(X,Y) - XQm(X,Y) 


for Z = 0. And for Z = 0, X2+ Y? = 1. Thus, for Z = 0, (6) is equivalent 
to 


sin 0P,,(cos 6, sin 6) — cos 9Qm(cos 8, sin @) = 0. 


That is, the critical points at infinity are determined by setting the highest 
degree terms in 0, as determined by (2), with r = 1, equal to zero. We 
summarize these results in the following theorem. 


Theorem 1. The critical points at infinity for the mth degree polynomial 
system (2) occur at the points (X,Y,0) on the equator of the Poincaré 
sphere where X2 + Y? =1 and 


XQm(X,Y) — YPm(X,Y) =0 (6) 
or equivalently at the polar angles 0; and 0; + 7 satisfying 
Gm+1(9) = cos8Qm(cos 9, sin 8) — sin6P,,(cos6,sin@) =0. (6) 


This equation has at most m+1 pairs of roots 8; and 6;+7 unless Gm41(8) 
is identically zero. If Gm+ (9) is not identically zero, then the flow on the 
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equator of the Poincaré sphere is counter-clockwise at points corresponding 
to polar angles @ where Gm+i(0) > 0 and it is clockwise at points corre- 
sponding to polar angles 8 where Gm41(8) < 0. 


The behavior of the solution curves defined by (5) in a neighborhood of 
any critical point at infinity, i.e. any critical point of (5) on the equator of 
the Poincaré sphere S, can be determined by projecting that neighborhood 
onto a plane tangent to S? at that point; cf. [L], p. 205. Actually, it is only 
necessary to project the hemisphere with X > 0 onto the plane X = 1 
and to project the hemisphere with Y > 0 onto the plane Y = 1 in order 
to determine the behavior of the flow in a neighborhood of any critical 
point on the equator of S?. This follows because the flow on S? defined by 
(5) is topologically equivalent at antipodal points of S? if m is odd and it 
is topologically equivalent, with the direction of the flow reversed, if m is 
even; cf. Figure 1. We can project the flow on S? defined by (5) onto the 
plane X = 1 by setting X = 1 and dX = 0 in (5). Similarly we can project 
the flow defined by (5) onto the plane Y = 1 by setting Y = 1 and dY =0 
in (5). Cf. Figure 3. This leads to the results summarized in Theorem 2. 


Figure 3. The projection of S? onto the planes X = 1 and Y = 1. 


Theorem 2. The flow defined by (5) in a neighborhood of any critical point 
of (5) on the equator of the Poincaré sphere S*, except the points (0, +1,0), 
is topologically equivalent to the flow defined by the system 
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ty = wp (2,4) -2"9(2,2) 

1 Zz 2 (7) 
+z = z™t!p @ “) : 

z2 2 


the signs being determined by the flow on the equator of S® as determined 
in Theorem 1. Similarly, the flow defined by (5) in a neighborhood of any 
critical point of (5) on the equator of S?, except the points (+1,0,0), is 
topologically equivalent to the flow defined by the system 


+r = 


| 

& 

N 

3 
& 
| 

N | — 
eee 
i 

N 

3 
ae) 
a 
N18 
N |= 
SJ 


(7’) 
+z = 2™t!1Q 


the signs being determined by the flow on the equator of S? as determined 
in Theorem 1. 


Remark 2. A critical point of (7) at (yo, 0) corresponds to a critical point 
of (5) at the point 


_i  _w_ 4 

V1ity V1+y% 
on S?; and a critical point of (7’) at (ro, 0) corresponds to a critical point 
of (5) at the point 


Zo 1 
——. , —; 0 
(sets V¥1+25 
on S?2. 


Example 1. Let us determine the flow on the Poincaré sphere S* defined 
by the planar system 


r=f 
y=-y. 


This system has a saddle at the origin and this is the only (finite) critical 
point of this system. The saddle at the origin of this system projects, under 
the central projection shown in Figure 1, onto saddles at the north and 
south poles of 5? as shown in Figure 4. According to Theorem 1, the 
critical points at infinity for this system are determined by the solutions of 


XQ1(X,Y) —YP,(X,Y) = -2XY =0; 
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Figure 4. The flow on the Poincaré sphere S? defined by the system of 
Example 1. 


ie., there are critical points on the equator of S? at +(1,0,0) and at 
+(0,1,0). Also, we see from this expression that the flow on the equator of 
S? is clockwise for XY > 0 and counter-clockwise for XY < 0. According 
to Theorem 2, the behavior in a neighborhood of the critical point (1,0, 0) 
is determined by the behavior of the system 


=u (2)+() 


or equivalently 


near the origin. This system has a stable (improper) node at the origin 
of the type shown in Figure 2 in Section 1.5 of Chapter 1. The y-axis 
consists of trajectories of this system and all other trajectories come into 
the origin tangent to the z-axis. This completely determines the behavior 
at the critical point (1,0,0); cf. Figure 4. The behavior at the antipodal 
point (—1,0,0) is exactly the same as the behavior at (1,0,0), i-e., there 
is also a stable (improper) node at (—1,0,0), since m = 1 is odd in this 
example. Similarly, the behavior in a neighborhood of the critical point 
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Figure 5. The global phase portrait for the system in Example 1. 


(0, 1,0) is determined by the behavior of the system 


x=22x 


Z=2 


near the origin. We see that there are unstable (improper) nodes at (0,+1, 0) 
as shown in Figure 4. The fact that the x and y axes of the original sys- 
tem consist of trajectories implies that the great circles through the points 
(+1,0,0) and (0,+1,0) consist of trajectories. Putting all of this informa- 
tion together and using the Poincaré-Bendixson Theorem yields the flow 
on S? shown in Figure 4. 


If we project the upper hemisphere of the Poincaré sphere shown in Fig- 
ure 4 orthogonally onto the unit disk in the (z, y)-plane, we capture all of 
the information about the behavior at infinity contained in Figure 4 in a 
planar figure that is much easier to draw; cf. Figure 5. The flow on the unit 
disk shown in Figure 5 is referred to as the global phase portrait for the 
system in Example 1 since Figure 5 describes the behavior of every tra- 
jectory of the system including the behavior of the trajectories at infinity. 
Note that the local behavior near the stable node at (1,0,0) in Figure 4 
is determined by the local behavior near the antipodal points (£1,0) in 
Figure 5. 

Notice that the separatrices partition the unit sphere in Figure 4 or the 
unit disk in Figure 5 into connected open sets, called components, and 
that the flow in each of these components is determined by the behavior of 
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one typical trajectory (shown as a dashed curve in Figure 5). The separa- 
trix configuration shown in Figure 5, and discussed more fully in the next 
section, completely determines the global phase portrait of the system of 
Example 1. 


Example 2. Let us determine the global phase portrait of the quadratic 
system 

=r’ +y*-1 

y = 5(zy — 1) 


considered by Lefschetz [L] on p. 204 and originally considered by Poincaré 
[P] on p. 66. Since the circle x? + y? = 1 and the hyperbola zy = 1 do 
not intersect, there are no finite critical points of this system. The critical 
points at infinity are determined by 


XQ2(X,Y) —YP,(X,Y) = Y(4X? —Y?) =0 


together with X?2 + Y? = 1. That is, the critical points at infinity are at 
+(1,0,0), +(1,2,0)/V5 and +(1,—2,0)/V5. Also, for X = 0 the above 
quantity is negative if Y > 0 and positive if Y < 0. (In fact, on the entire 
y-axis, 0 < 0 if y > 0 and 0 > 0 if y < 0.) This determines the direction of 
the flow on the equator of S?. According to Theorem 2, the behavior near 
each of the critical points (1,0,0), (1,2,0)//W5 and (1, —2,0)/V5 on S? is 


determined by the behavior of the system 
y = 4y — 527 — y? + yz? 
z= -z-—2zy?4+2? 


(8) 


near the critical points (0,0), (2,0) and (—2,0) respectively. Note that the 
critical points at infinity correspond to the critical points on the y-axis of 
(8) which are easily determined by setting z = 0 in (8). For the system (8) 
we have 


Df£(0,0) = F a and Df(+2,0) = Fe |: 


Figure 6. The behavior near the critical points of (8). 
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Thus, according to Theorems 3 and 4 in Section 2.10 of Chapter 2, (0,0) 
is a saddle and (42,0) are stable (improper) nodes for the system (8); cf. 
Figure 6. Since m = 2 is even in this example, the behavior near the an- 
tipodal points —(1, 0,0), —(1,2,0)/V5 and —(1, —2,0)/V5 is topologically 
equivalent to the behavior near (1,0,0), (1,2,0)/W5 and (1, —2,0)/V5 re- 
spectively with the directions of the flow reversed; i.e., —(1,0,0) is a saddle 
and —(1,+2,0)//5 are unstable (improper) nodes. Finally, we note that 
along the entire x-axis y < 0. Putting all of this information together and 
using the Poincaré-Bendixson Theorem leads to the global phase portrait 
shown in Figure 7; cf. Problem 1. 


Figure 7. The global phase portrait for the system in Example 2. 


The next example illustrates that the behavior at the critical points at 
infinity is typically more complicated than that encountered in the previous 
two examples where there were only hyperbolic critical points at infinity. 
In the next example, it is necessary to use the results in Section 2.11 of 
Chapter 2 for nonhyperbolic critical points in order to determine the be- 
havior near the critical points at infinity. Note that if the right-hand sides 
of (7) or (7’) begin with quadratic or higher degree terms, then even the 
results in Section 2.11 of Chapter 2 will not suffice to determine the behav- 
ior at infinity and a more detailed analysis in the neighborhood of these 
degenerate critical points will be necessary; cf. [N/S]. The next theorem 
which follows from Theorem 1.1 and its corollaries on pp. 205 and 208 in 
(H] is often useful in determining the behavior of a planar system near a 
degenerate critical point. 
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Theorem 3. Suppose that f € C!(E) where E is an open subset of R? 
containing the origin and the origin is an isolated critical point of the sys- 
tem 

x = f(x). (9) 
For § > 0, let Q = {(r,0) € R? |0<1r < 5,0, < 0 < 62} C E be a sector 
at the origin containing no critical points of (9) and suppose that 6 > 0 for 
0<r< 6 and 0 = 4 and that 0 < 0 for0 <r <6 and 6 = 0,. Then for 
sufficiently small 6 > 0 


(i) ifr < 0 forr = 6 and 0; < @ < Oo, there exists at least one half- 
trajectory with its endpoint on R = {(r,6) € R? |r = 6,0, < 8 < 65} 
which approaches the origin as t — 00; and 


(ii) if >0 forr =6 and 0; < @ < 69, then every half-trajectory with its 
endpoint on R approaches the origin as t + —oo. 


Example 3. Let us determine the global phase portrait of the system 


&=—-y(1+2)+ar+(a+1)z? 

y=2(1+72) 
depending on a parameter a € (0,1). This system was considered in Exam- 
ple 2 in Section 3.8 where we showed that for a € (0,1) there is exactly one 
stable limit cycle around the critical point at the origin. Also, the origin is 


the only (finite) critical point for this system. The critical points at infinity 
are determined by 


XQ2(X,Y) — YP2(X,Y) = X[X? - (a+ 1)XY + Y?] =0. 


For 0 < a < 1, this equation has X = 0 as its only solution. Thus, the only 
critical points at infinity are at +(0,1,0). And from (7’), the behavior at 


(0, 1,0) is determined by the behavior of the system 
-f=2+2z-arz—-(a41)224+2°z423 

,_ 2 2 (10) 

—Z = 27°2+ 272 


at the origin. In this case the matrix A = Df(0) for this system has one 
zero eigenvalue and Theorem 1 of Section 2.11 of Chapter 2 applies. In 
order to use that theorem, we must put the above equation in the form 
of equation (2) in Section 2.11 of Chapter 2. This can be done by letting 
y = x +z and determining y = z + z from the above equations. We find 
that 


y=y+tae(y,z) = —yt2?—(at2)yzt+ (at ly? +y?z-y" 
= poy, z) = yz” — yz. 
Solving y + qo(y, z) = 0 in a neighborhood of the origin yields 
y = 9(z) = 27[1 — (a + 2)z] + 0(z*) 
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and then 
Po(z, $(z)) = 24 — (a + 3)z° + 0(z°). 

Thus, in Theorem 1 of Section 2.11 of Chapter 2 we have m = 4 (and 
Gm = 1). It follows that the origin of (10) is a saddle-node. Since z = 0 on 
the z-axis (where z = 0) in equation (10), the z-axis is a trajectory. And for 
z = 0 we have « = r—(a+1)z?+24 in (10). Therefore, z > 0 for s > 0 and 
& <0 for z < 0 on the z-axis. Next, on z = —z we have z = x? + 0(z*) > 0 
for small z 4 0. And for sufficiently small r > 0, we have r > 0 for 
—z < x < 0 in (10). On the z-axis we have « = —z < 0 for x > 0. Thus, 
by Theorem 3, there is a trajectory of (10) in the sector 7/2 < 6 < 37/4 
which approaches the origin as t —> —oo; cf. Figure 8(a). It follows that 
the saddle-node at the origin of (10) has the local phase portrait shown in 
Figure 8(b). It then follows, using the Poincaré~Bendixson Theorem, that 
the global phase portrait for the system in this example is given in Figure 9; 
cf. Problem 2. 


(a) (b) 


Figure 8. The saddle-node at the origin of (10). 


The projective geometry and geometrical ideas presented in this section 
are by no means limited to flows in R? which can be projected onto the up- 
per hemisphere of S? by a central projection in order to study the behavior 
of the flow on the circle at infinity, i.e., on the equator of S?. We illustrate 
how these ideas can be carried over to higher dimensions by presenting the 
theory and an example for flows in R*. The upper hemisphere of S? can 
be projected onto R3 using the transformation of coordinates given by 

X Y Z 


— = —— 


w’ 9-w WwW 


3 


and 


Vee Yes FY - ge Fe | _. 
V1 + |x|?’ V1 + |x|?’ V1 + |x|?’ V1 + |x|? 
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for X = (X,Y,Z,W) € S® with |X| = 1 and for x = (z,y,z) € R*. If we 
consider a flow in R® defined by 


z= P(z,y, z) 
y = Q(z, y, z) (11) 
z= R(z, y,z) 


where P,Q, and R are polynomial functions of z, y, z of maximum degree 
m, then this system can be equivalently written as 


dy _QAry2z) 4 dz _ Rlzy2) 
dx P(z,y,z) dx P(z,y,z) 


or as 
Q(z,y,z)drz — P(z,y,z)dy=0 and R(z,y,z)dx — P(z,y,z)dz =0 


in which cases the direction of the flow along trajectories is no longer 


Figure 9. The global phase portrait for the system in Example 3. 


determined. And then since 

WdX — XdW WdY —- YdW dd 
= — yr dy = ——aa—— and az Ww? 
we can write the system as 


Q*(WdX — WdW) — P*(WdY — YdW) =0 


dz 


and 
R*(WdX — XdW) — P*(WdZ — ZdW) = 0, 
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if we define the functions 


P*(X) = Z™P(X/W) 
Q*(X) = Z"Q(X/W) 


and 


R*(X) = Z™R(X/W). 


Then corresponding to Theorems 1 and 2 above we have the following 
theorems. 


Theorem 4. The critical points at infinity for the mth degree polynomial 
system (11) occur at the points (X,Y, Z,0) on the equator of the Poincaré 
sphere S? where X? + Y? + Z? =1 and 


XQm(X,Y,Z) — Y Pm(X,Y, Z) =0 
X Rn(X,Y,Z) — ZPm(X,Y, Z) =0 
and 
Y Rm(X,Y,Z) —- ZQm(X,Y, Z) =0 
where Pn, Qm and Ry, denote the mth degree terms in P, Q, and R re- 


spectively. 


Theorem 5. The flow defined by the system (11) in a neighborhood 
(a) of (£1,0,0,0) € S® is topologically equivalent to the flow defined by 
the system 


(b) of (0, +1,0,0) € S* is topologically equivalent to the flow defined by 
the system 
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and 
(c) of (0,0,+1,0) € S® is topologically equivalent to the flow defined by 
the system 
+¢=2w™R (2 ¥ = ~w™p(= 4% ie 
yw’ www 
zyil xzyil 
a mp([o 2 2)—yw™ Me a) <r 
ty = yw (2.4) w q(2,4,<) 
ty =w™tiR( = 4 : 
www 


The direction of the flow, i.e., the arrows on the trajectories representing 
the flow, is not determined by Theorem 5. It follows from the original 
system (11). Let us apply this theory for flows in R? to a specific example. 


Example 4. Determine the flow on the Poincaré sphere S? defined by the 
system 


y=y 
Z=-2z 


in R*. From Theorem 4, we see that the critical points at infinity are 
determined by 


XQ: -YP,=XY-YX =0 
XP, -XR, = ZX4+XZ=2XZ=0 


and 


YR, —-ZQ; = Y(-Z) —- ZY = 2YZ =0. 


These equations are satisfied iff X = Y = 0 or Z = Oand X?7+Y?+2Z? = 1; 
ie., the critical points on S? are at (0,0,+1,0) and at points (X, Y,0,0) 
with X2 4+ Y? = 1. According to Theorem 5(c), the flow in a neighborhood 
of (0,0,+1,0) is determined by the system 


where we have used the original system to select the minus sign in Theo- 
rem 5(c). We see that (0,0, +1, 0) is an unstable node. The flow at any point 
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(X.Y,0.0) with X2 + Y? = 1 such as the point (1,0,0,0) is deterinined by 
the system in Theorem 5(a): 


where we have used the original system to select the minus sign in The- 
orem 5(a). We see that (1,0.0,0) is a nonisolated, stable critical point. 
We can summarize these results by projecting the upper hemisphere of the 
Poincaré sphere S* onto the unit ball in R?; this captures all of the infor- 
mation about the flow of the original systein in R? and it also includes the 
behavior on the sphere at infinity which is represented by the surface of 
the unit ball in R°. Cf. Figure 10. 


Figure 10. The “global phase portrait” for the system in Example 4. 


Before ending this section, we shall define what we mean by a vector 
field on an n-dimensional manifold. In Example 1, we saw that a flow on 
R? defined a flow on the Poincaré sphere S; cf. Figure 4. This flow on S? 
defines a corresponding vector field on S?, namely, the set of all velocity 
vectors v tangent to the trajectories of the flow on S?. Each of the velocity 
vectors v lies in the tangent plane T,S? to S? at a point p € S*. We 
now give a more precise definition of a vector field on an n-dimensional 
differentiable manifold Af. We shall use this definition for two-dimensional 
nianifolds in Section 3.12 on index theory. Since any n-dimensional manifold 
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M can be embedded in R% for some N with n < N < 2n+1 by Whitney’s 
Theorem, we assume that M C RN in the following definition. 

Let M be an n-dimensional differentiable manifold with M Cc R.A 
smooth curve through a point p € M is a C'-map ¥: (—a,a) — M with 
(0) = p. The velocity vector v tangent to + at the point p = 7(0) € M, 


v = D+(0). 


The tangent space to M at a point p € M, TpM, is the set of all velocity 
vectors tangent to smooth curves passing through the point p € M. The 
tangent space T,M is an n-dimensional linear space and we shall view it 
as a subspace of R". A vector field f on M is a function f: M — R® such 
that f(p) € T,™ for all p € M. If we define the tangent bundle of M, TM, 
as the disjoint union of the tangent spaces T,M to M for p € M, then a 
vector field on M,f: M—TM. 

Let {(Ua,ha)}a be an atlas for tle n-dimensional manifold M and let 
Va = ha(U,). Recall that if the maps h, o h5’ are all C*-functions, then 
M is called a differentiable manifold of class C*. For a vector field f on M 
there are functions f,: V, —~ R” such that 


f(g '(x)) = Dhy'(x)fa(x) 


for all x € V,. Note that under the change of coordinates x — hg o hg o 
hz !(x) we have 


fa(hg oh '(x)) = Dhg o hg '(x)fa(x) 


for all x with hz'(x) € U.N Ug. If the functions f,: Vz — R” are all 
in C!(V,) and the manifold M is at least of class C?, then f is called a 
C'-vector field on M. 
A general theory, analogous to the local theory in Chapter 2, can be 
developed for the system 
x = f(x) 


where x € M, an n-dimensional differentiable manifold of class C?, and f is 
a C!-vector field on M. In particular, we have local existence and uniquc- 
ness of solutions through any point xo € M. A solution or integral curve 
on M, @,(xo) is tangent to the vector field f at xo. If M is compact and 
f is a C}-vector field on M then, by Chillingworth’s Theorem, Theorem 4 
in Section 3.1, O(¢,z9) = $,(Zo) is defined for all ¢ € R and xo € M and 
it can be shown that ¢ € C'(R x M); 6,9, = $,4,; and ¢;, is called a 
flow on the manifold M. We have already seen several examples of flows on 
the two-dimensional manifolds S? and T? (and of course R). In order to 
make these ideas more concrete, consider the following simple example of 
a vector field on the one-dimensional, compact manifold 


C=S' = {x € R? | |x| = 1}. 
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Example 5. Let C be the unit circle in R?. Then C can be represented 
by points of the form x(@) = (cos@,sin@)?. C is a one-dimensional dif- 
ferentiable manifold of class C'‘®. An atlas for C is given in Problem 7 in 
Section 2.7 of Chapter 2. For each @ € [0.27), the tangent space to the 
manifold Af = C at the point p(@) = (cos@.sin@)? € M 


Tyo) M = {x € R? | xcos6 + ysin# = 1} 


and the function 


defines a C!-vector field on M; cf. Figure 11. Note that we are viewing 
TpM as a subspace of R? and the vector f(p) as a free vector which can 
either be based at the origin 0 € R? or at the point p € M. 


Figure 11. A vector field on the unit circle. 


The solution to the system 
x = f(x) 
through a point p(@) = (cos@,sin@)? € M is given by 


cos(t + 6) 
$,(p(4)) = ew: ae )) . 
The flow ¢, represents the motion of a point moving counterclockwise 
around the unit circle with unit velocity v = @,(p) tangent to C at the 


point ¢,(p). 
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If the charts (U;,h,) and (U2, he) are given by 
U, = {(z,y) €R? |y= Vi-2?,-l<2r< 1} 
hi(z,y) = 2z,hy'(z) = (z, vi-#) 
Up = {(z,y) € R?| z= J1—-y2,-l<y< 1} 


a | T 
ho(z, y) =y and h, (y) = ( 1—y?,y) ’ 
then 
1 —y 

owia=(_cs,), omree (79) 
l-—z 1 

and for the functions 
fi(z)=-V1-—2? and fe(y) = V1-y? 


where —1 < z < 1 and —-1 < y < 1, we have 


(EVvio=)= ~ 128) = Dai x)fl2) 


y 


f£(/1—y2,y) = (_ =a) = Dhz'(y) fo(y). 
It is also easily shown that 
hooh;'(z) = V1—22, Dhgohj'(z) = 
and that for z > 0 


fo(V1—2?) =z=Dh2o hy} (z)fi(z). 


and 


—2Z 


l-—z 


PROBLEM SET 10 


1. Complete the details in obtaining the global phase portrait for Ex- 
ample 2 shown in Figure 7. In particular, show that 


(a) The separatrices approaching the saddle at the origin of sys- 
tem (8) do so in the first and fourth quadrants as shown in 
Figure 6. 


(b) In the global phase portrait shown in Figure 7, the separatrix 
having the critical point (1,0, 0) as its w-limit set must have the 
unstable node at (—1,2,0)/V/5 as its a-limit set. Hint: Use the 
Poincaré—Bendixson Theorem and the fact that y < 0 on the 
x-axis for the system in Example 2. 
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. Complete the details in obtaining the global phase portrait for Ex- 


ample 3 shown in Figure 9. In particular, show that the flow swirls 
counter-clockwise around the origin for the system in Example 3 and 
that the limit cycle of the system in Example 3 is the w-limit set of 
the separatrix which has the saddle at (0,1,0) as its a-limit set. 


. Draw the global phase portraits for the systems 


z=2z2 
(a) y=y 
2=7 
b 
( ley 
Z=2-y 
©) paaty 


. Draw the global phase portrait for the system 


r= —4y + 2ry —8 
y = 4y? — 2. 
Note that the nature of the finite critical points for this system was 


determined in Problem 4 in Section 2.10 of Chapter 2. Also, note that 
on the z-axis y < 0 for z £ 0. 


. Draw the global phase portrait for the system 


z= 22 — 2ry 
y=2y—2?+y’. 
Note that the nature of the finite critical points for this system was 


determined in Problem 4 in Section 2.10 of Chapter 2. Also, note the 
symmetry with respect to the y-axis for this system. 


. Draw the global phase portrait for the system 


& = —2? —y*? 41 
y = 22. 


The same comments made in Problem 5 apply here. 


. Draw the global phase portrait for the system 


&= —z? -y?+1 
y = Qzry. 


The same comments made in Problem 5 apply here and also, note 
that this system is symmetric with respect to both the z and y axes. 
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8. Draw the global phase portrait for this system 


t=z?-y*-1 

y = 2y. 
Note that the nature of the finite critical points for this system was 
determined in Problem 4 in Section 2.10 of Chapter 2. Also, note the 


symmetry with respect to the z-axis for this system. Hint: You will 
have to use Theorem 1 in Section 2.11 of Chapter 2 as in Example 3. 


9. Let M be the two-dimensional manifold 
S? = {xe R?| 224+ y?4 2? = 1}. 

(a) Show that any point po = (zo, yo, 20) € S*, the tangent space 

to S? at the point po 
Tp,M = {x eR? | rz9 + yyo + 229 = 1}. 

(b) What condition must the components of f satisfy in order that 
the function f defines a vector field on M = S?? 

(c) Show that the vector field on S? defined by the differentiable 
equation (5) is given by 
f(x) = (ryQ* —(y?+2z*)P*, zyP* — (2? + 27)Q*, 2zP* +y2zQ*)? 


where P*(z,y,z) and Q*(z, y, z) are defined as in equation (5); 
and show that this function satisfies the condition in part (b). 
Hint: Take the cross product of the vector of coefficients in 
equation (5) with the vector (x,y,z)? € S? to obtain f. 


10. Determine which of the global phase portraits shown in Figure 12 be- 
low correspond to the following quadratic systems. Hint: Two of the 
global phase portraits shown in Figure 12 correspond to the quadratic 
systems in Problems 2 and 3 in Section 3.11. 


z= —4y+ 2ry —8 


(a) y = 4y? — 2? 
x= 22 — 2zry 
ene 
(c) t= -a'-y' +1 

y = 22 


: 2 2 
g=-T’—y~+)1 
Qa 
y = sry 
g=g?-y?-1 


te) y = dy 
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Set up a one-to-one correspondence between the global phase por- 


traits (or separatrix configurations), shown in Figure 12 and the 
computer-drawn global phase portraits in Figure 13. 


11. 


(i) (ii) 
(ill) (iv) (v) 
(vi) (vii) 


Figure 12. Global phase portrait of various quadratic systems. 
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12. 


13. 


The system of differential equations in Problem 10(c) above can be 
written as a first-order differential equation, 
Qedx — (1 — 2? — y”)dy =0. 


Show that e” is an integrating factor for this differential equation; 
i.e., show that when this differential equation is multiplied by e’, 
it becomes an exact differential equation. Solve the resulting exact 
differential equation and use the solution to obtain a formula for the 
homoclinic loop at the saddle point (0, —1) of the system 10(c). 


Analyze the critical point at the origin of the system 
=x — 32y? 
y = 327 —y® 
by the method of “blowing-up” outlined below: 
(a) Write this system in polar coordinates to obtain 
dr _ r(z* —y’) 
do Qry 


(b) Project the z, y-plane onto the Bendixson sphere. This is most 
easily done by letting p = 1/r, € = pcos@ and n = psin#@. You 
should obtain 


dp__idr_ _(é? —n) 
d6-—s r2dO 2£n 
or equivalently 
E=€ 
7 = —". 


(c) Now project the £,7-plane onto the Poincaré sphere as in Ex- 
ample 1. In this case, there are four hyperbolic critical points at 
infinity and they are all nodes. If we now project from the north 
pole of the Poincaré sphere (shown in Figure 4) onto the €,7- 
plane, we obtain the flow shown in Figure 14(a). This is called 
the “blow-up” of the degenerate critical point of the original 
system. By shrinking the circle in Figure 14(a) to a point, we 
obtain the flow shown in 14(b) which describes the flow of the 
original system in a neighborhood of the origin. 


In general, by a finite number of “blow-ups,” we can reduce the study 
of a complicated critical point at the origin to the study of a finite 
number of hyperbolic critical points on the equator of the Poincaré 
sphere. It is interesting to note that the flow on the Bendixson sphere 
for this problem is given in Figure 15. 
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(a) (b) 


Figure 14. The blow-up of a degenerate critical point with four elliptic 
sectors. 


oo 


Figure 15. The flow on the Bendixson sphere defined by the system in 
Problem 13. 
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3.11 Global Phase Portraits and Separatrix 
Configurations 


In this section, we present some ideas developed by Lawrence Markus [20] 
concerning the topological equivalence of two C!-systems 


x = f(x) (1) 


and 
x = g(x) (2) 


on R?. Recall that (1) and (2) are said to be topologically equivalent on 
R? if there exists a homeomorphism H: R* — R? which maps trajectories 
of (1) onto trajectories of (2) and preserves their orientation by time; cf. 
Definition 2 in Section 3.1. The homeomorphism H need not preserve the 
parametrization by time. 

Following Markus [20], we first of all extend our concept of what types of 
trajectories of (1) constitute a separatrix of (1) and then we give necessary 
and sufficient conditions for two relatively prime, planar, analytic systems 
to be topologically equivalent on R?. Markus established this result for C?- 
systems having no “limit separatrices”; cf. Theorem 7.1 in [20]. His results 
apply directly to relatively prime, planar, analytic systems since they have 
no limit separatrices. In fact, the author [24] proved that if the components 
P and Q of f = (P,Q)? are relatively prime, analytic functions, i.e., if (1) 
is a relatively prime, analytic system, then the critical points of (1) are 
isolated. And Bendixson [B] proved that at each isolated critical point xo 
of a relatively prime, analytic system (1) there are at most a finite number of 
separatrices or trajectories of (1) which lie on the boundaries of hyperbolic 
sectors at xo; cf. Theorem IX, p. 32 in [B]. 

In order to make the concept of a separatrix as clear as possible, we first 
give a simplified definition of a separatrix for polynomial systems and then 
give Markus’s more general definition for C!-systems on R?. While the first 
definition below applies to any polynomial system, it does not in general 
apply to analytic systems on R?; cf. Problem 6. 


Definition 1. A separatriz of a relatively prime, polynomial system (1) is 
a trajectory of (1) which is either 


(i) a critical point of (1) 
(ii) a limit cycle of (1) 


(iii) a trajectory of (1) which lies on the boundary of a hyperbolic sector 
at a critical point of (1) on the Poincaré sphere. 


In order to present Markus’s definition of a separatrix of a C'-system, 
it is first necessary to define what is meant by a parallel region. In [20] a 
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parallel region is defined as a collection of curves filling a plane region R 
which is topologically equivalent to either the plane filled with parallel lines, 
the punctured plane filled with concentric circles, or the punctured plane 
filled with rays from the deleted point; these three types of parallel regions 
are referred to as strip, annular, and spiral or radial regions respectively by 
Markus. These three basic types of parallel regions are shown in Figure 1 
and several types of strip regions are shown in Figure 2. 


Figure 1. Various types of parallel or canonical regions of (1); strip, annular 
and spiral regions. 


OO 2 @ 


Figure 2. Various types of strip regions of (1); elliptic, parabolic and hy- 
perbolic regions. 


Definition 1’. A solution curve I of a C!-system (1) with f € C!(R?) is 
a separatriz of (1) if I is not embedded in a parallel region N such that 


(i) every solution of (1) in N has the same limit sets, a([‘) and w(I), as 
I’ and 


(ii) N is bounded by a(I') Uw(T) and exactly two solution curves I’, and 
T2 of (1) for which a([',) = a([2) = a(L) and w(T)) = w(T2) = w(P). 
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Theorem 1. If (1) is a C'-system on R?, then the union of the set of 
separatrices of (1) is closed. 


This is Theorem 3.1 in [20]. Since the union of the set of separatrices of 
a relatively prime, analytic system (1), 5, is closed, R? ~ S is open. The 
components of R? ~ S, i.e., the open connected subsets of R? ~ S, are 
called the canonical regions of (1). In Theorem 5.2 in [20], Markus shows 
that all of the canonical regions are parallel regions. 


Definition 2. The separatriz configuration for a C}-system (1) on R? is 
the union S of the set of all separatrices of (1) together with one trajectory 
from each component of R? ~ S. Two separatrix configurations S, and S2 
of a C!-system (1) on R? are said to be topologically equivalent if there 
is a homeomorphism H: R? — R? which maps the trajectories in S; onto 
the trajectories in Sj and preserves their orientation by time. 


Theorem 2 (Markus). Two relatively prime, planar, analytic systems 
are topologically equivalent on R? if and only if their separatriz configura- 
tions are topologically equivalent. 


This theorem follows from Theorem 7.1 proved in [20] for C}-systems 
having no limit separatrices. In regard to the global phase portraits of 
polynomial systems discussed in the previous section, this implies that on 
the Poincaré sphere S?, it suffices to describe the set of separatrices S of 
(1), the flow on the equator E of S? and the behavior of one trajectory 
in each component of S? ~ (SU E) in order to uniquely determine the 
global behavior of all trajectories of a polynomial system (1) for all time. 
However, in order for this statement to hold on the Poincaré sphere S?, it is 
necessary that the critical points and separatrices of (1) do not accumulate 
at infinity, i.e., on the equator of S?. This is certainly the case for relatively 
prime, polynomial systems as long as the equator of S? does not contain 
an infinite number of critical points as in Problem 3(b) in Section 3.10. 

Several examples of separatrix configurations which determine the global 
behavior of all trajectories of certain polynomial systems on R? for all time 
were given in the previous section; cf. Figures 5, 7, 9 and 12 in Section 3.10. 
We include one more example in this section in order to illustrate the idea 
of a Hopf bifurcation which we discuss in detail in Section 4.4. 


Example 1. For a € (—1, 1), the quadratic system 


z=azr—yt+(a+1)z? — zy 
y=2rt+2? 


was considered in Example 2 of Section 3.8, in Example 1 in Section 3.9, 
and in Example 3 of Section 3.10. The origin is the only finite critical 
point of this system; for a € (—1,1), there is a saddle-node at the critical 
point (0,+1,0) at infinity as shown in Figure 9 of Section 3.10; for a € 
(—1,0] this system has no limit cycles; and for a € (0,1) there is a unique 
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limit cycle around the origin. The global phase portrait for this system is 
determined by the separatrix configurations on (the upper hemisphere of) 
S? shown in Figure 3. 


ae (-1,0) ae (0,1) 


Figure 3. The separatrix configurations for the system of Example 1. 


There is a significant difference between the two separatrix configura- 
tions shown in Figure 3. One of them contains a limit cycle while the other 
does not. Also, the stability of the focus at the origin is different. It will be 
shown in Chapter 4, using the theory of rotated vector fields, that a unique 
limit cycle is generated when the critical point at the origin changes its 
stability at that value of a = 0. This is referred to as a Hopf bifurcation 
at the origin. The value a = 0 at which the global phase portrait of this 
system changes its qualitative structure is called a bifurcation value. Var- 
ious types of bifurcations are discussed in the next chapter. We note that 
for a € (—1,0) U (0,1), the system of Example 1 is structurally stable on 
R? (under strong C!-perturbations, as defined in Section 4.1); however, it 
is not structurally stable on S? since it has a nonhyperbolic critical point 
at (0,+1,0) € S?. Cf. Section 4.1 where we discuss structural stability. 


PROBLEM SET 11 


1. For the separatrix configurations shown in Figures 5, 7 and 9 in Sec- 
tion 3.10: 


(a) Determine the number of strip, annular and spiral canonical 
regions in each global phase portrait. 


(b) Classify each strip region as a hyperbolic, parabolic or elliptic 
region. 
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2. Determine the separatrix configuration on the Poincaré sphere for the 
quadratic system 


= —dr —2Qy+4 


y= ry. 


Hint: Show that the x-axis consists of separatrices. And use Theo- 
rems 1 and 2 in Section 2.11 of Chapter 2 to determine the nature of 
the critical points at infinity. 


3. Determine the separatrix configuration on the Poincaré sphere for the 
quadratic system 


t=y—2?+2 
y = 22? — Qzy. 


Hint: Use Theorem 2 in Section 2.11 of Chapter 2 in order to deter- 
mine the nature of the critical points at infinity. Also, note that the 
straight line through the critical points (2,2) and (0, —2) consists of 
separatrices. 


4. Determine the separatrix configuration on the Poincaré sphere for the 
quadratic system 


f=axr+2? 
y=y. 


Treat the cases a > 0, a = 0 and a < 0 separately. Note that a = 0 
is a bifurcation value for this system. 


5. Determine the separatrix configuration on the Poincaré sphere for the 
cubic system 


r=y 


y= —2z? + Ary 


and show that the four trajectories determined by the invariant curves 
y = r?/(2+V/2), discussed in Problem 1 of Section 2.11, are separatri- 
ces according to Definition 1. Hint: Use equation (7’) in Theorem 2 
of Section 3.10 to study the critical points at (0,+1,0) € S?. In 
particular, show that z = x?/(2 + V2) are invariant curves of (7’) 
for this problem; that there are parabolic sectors between these two 
parabolas; that there is an elliptic sector above z = z7/(2 — V2), a 
hyperbolic sector for z < 0 and two hyperbolic sectors between the 
z-axis and z = x7/(2+ V2). You should find the following separatrix 
configuration on S?. 
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6. Determine the global phase portrait for Gauss’ model of two compet- 


7. 


ing species 


z= az — br? —ray 
y = ay — by? — sry 


where a > 0, s > r > b > O. Using the global phase portrait show that 
it is mathematically possible, but highly unlikely, for both species to 
survive, i.e., for limy.. x(t) and lim;_.., y(t) to both be non-zero. 


(a) (Cf. Markus [20], p. 132.) Describe the flow on R? determined 
by the analytic system 


xZ=sinz 

y = cosz 
and show that, according to Definition 1’, the separatrices of 
this system consist of those trajectories which lie on the straight 
lines zx = nz, n = 0,+1,+2,.... Note that we can map any strip 
|x| < nz onto a portion of the Poincaré sphere using the central 
projection described in the previous section and that the sepa- 
ratrices of this system which lie in the strip |z| < nz are exactly 
those trajectories which lie on boundaries of hyperbolic sectors 
at the point (0, 1,0) on this portion of the Poincaré sphere as in 
Definition 1. 

(b) Same thing for the analytic system 
¢=sin?z 


y = cosz. 
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As Markus points out, these two systems have the same separa- 
trices, but they are not topologically equivalent. Of course, their 
separatrix configurations are not topologically equivalent. 


3.12 Index Theory 


In this section we define the index of a critical point of a C!-vector field 
f on R? or of a C!-vector field f on a two-dimensional surface. By a two- 
dimensional surface, we shall mean a compact, two-dimensional differen- 
tiable manifold of class C?. For a given vector field f on a two-dimensional 
surface S, if f has a finite number of critical points, p),..., Pm, the index 
of the surface S relative to the vector field f, Ig(S), is defined as the sum 
of the indices at each of the critical points, p),..., Pm in S. It is one of the 
most interesting facts of the index theory that the index of the surface S, 
I;(S), is independent of the vector field f and, as we shall see, only depends 
on the topology of the surface S; in particular, [¢(S) is equal to the Euler- 
Poincaré characteristic of the surface S. This result is the famous Poincaré 
Index Theorem. 

We begin this section with Poincaré’s definition of the index of a Jordan 
curve C (i.e., a piecewise-smooth simple, closed curve C) relative to a C!- 
vector field f on R?. 


Definition 1. The index Is(C) of a Jordan curve C' relative to a vector 
field f € C'(R?), where f has no critical point on C, is defined as the 


integer 


AS 
I(C) = > 


where A@ is the total change in the angle © that the vector f = (P,Q)? 
makes with respect to the z-axis, i.e., AO is the change in 


-1 Q(z, y) 
P(z,y)’ 

as the point (z, y) traverses C exactly once in the positive direction. 
The index I¢(C’) can be computer using the formula 


= 1 | dy a 1 -1 Q(z, y) 
Ig(C) = sz fdtan = zreD P(x. y) 
_ 1 f PdQ-QdP 
7 27 Cc P2 + Q? 


O(a, y) = tan 


Cf. [A-I], p. 197. 


Example 1. Let C be the circle of radius one, centered at the origin, and 
let us compute the index of C relative to the vector fields 


f(x) = (5) , g(x) = el? h(x) = e: and k(x) = (5) 
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These vector fields define flows having unstable and stable nodes, a center 
and a saddle at the origin respectively; cf. Section 1.5 in Chapter 1. The 
phase portraits for the flows generated by these four vector fields are shown 
in Figure 1. According to the above definition, we have 


I(C)=1, Ig(C)=1, In(C)=1, and h(C) =-1. 


These indices can also be computed using the above formula; cf. Problem 1. 


: 
Figure 1. The flows defined by the vector fields in Example 1. 


We now outline some of the basic ideas of index theory. We first need to 
prove a fundamental lemma. 


Lemma 1. If the Jordan curve C is decomposed into two Jordan curves, 
C=C, +Cz, as in Figure 2, then 


Ie(C) = Ig(C1) + Ie(C2) 
with respect to any C!-vector field f € C'(R?). 


Proof. Let p, and pz be two distinct points on C which partition C into 
two arc A, and Ad as shown in Figure 2. Let Ap denote an arc in the interior 
of C from p; to pg and let —Ag denote the arc from pe to p; traversed in 
the opposite direction. Let C, = A; + Ao and let Cz = A2 — Ao. 

It then follows that if A©|,4 denotes the change in the angle O(z, y) 
defined by the vector f(x) as the point x = (x,y)? moves along the arc A 
in a well-defined direction, then AO|_4 = —A®|, and 


1 
IC) = 5, ASla: + A&|a,] 
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Po 
Po 


P, 
P, 


Figure 2. A decomposition of the Jordan curve C into C, + C2. 


1 
1 
= 57 AP lA +40 + A®|Az- Ao] 


l 
= 5, AGle: + AO\c,] 
= I¢(C;) + I¢(C2). 


Theorem 1. Suppose that f € C'(E) where E is an open subset of R? 
which contains a Jordan curve C and that there are no critical points of f 
on C or in its interior. It then follows that Ig(C) = 0. 


Proof. Since f = (P,Q)! is continuous on E it is uniformly continuous on 
any compact subset of &. Thus, given « = 1, there is a 6 > 0 such that 
on any Jordan curve C’, which is contained inside a square of side 6 in E, 
we have 0 < I[¢(Ca) < €; cf. Problem 2. Then, since I(Cq) is a positive 
integer, it follows that Ip(C,) = 0 for any Jordan curve C, contained inside 
a square of side 6. We can cover the interior of C’, Int C, as well as C' with 
a square grid where the squares Sq in the grid have sides of length 6/2. 
Choose 6 > 0 sufficiently small that any square Sy with SgNIntC # O lies 
entirely in E and that Ig¢(Ca) = 0 where C, is the boundary of S$, N Int C. 
Since the closure of Int C’ is a compact set, a finite number of the squares 
Sq cover Int C’, say S;, 7 = 1,...,N. And by Lemma 1, we have 


N 
Ig(C) = Y— Ie(C;) = 0. 
j=l 


Corollary 1. Under the hypotheses of Theorem 1, if C, and C2 are Jordan 
curves contained in E with C, C Int Co, and if there are no critical points 
of f in IntCgN Ext C,, then I¢(C,) = I¢(C2). 


Definition 2. Let f € C!(E) where E is an open subset of R? and let 
Xo € E be an isolated critical point of f. Let C be a Jordan curve contained 
in E and containing x9 and no other critical point of f on its interior. Then 
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the index of the critical point xo with respect to f 
I¢(x0) = Ie(C). 


Theorem 2. Suppose that f € C!(E) where E is an open subset of R? 
containing a Jordan curve C’. Then if there are only a finite number of 
critical points, X,,...,Xn of f in the interior of C, it follows that 


N 
Ie(C) = D7 Ielx3). 
j=) 
This theorem is proved by enclosing each of the critical points x, by 
a small circle C; lying in the interior of C as in Figure 3. Let a and b 


Figure 3. The decomposition of the Jordan curves C, C),...,Cw. 


be two distinct points on C’. Since the interior of C, Int C, is arc-wise 
connected, we can construct arcs AX], %1X2,.-.,Xnb on the interior of C. 
Let Ao, Ai,..., An denote the part of these arcs on the exteriors of the 
circles C,...,Cyw as in Figure 3. The curves C, C,...,Cy are then split 
into two parts, C*.C-5Cy, rere OP Ore by the arcs Ao,..., Aw as in 
Figure 3. 

Define the Jordan curves J) = C+ + Ag —-Cy} —----Ch, +Awn and J2 = 
C7 —-An —Cy —:::—Cy — Ao. Then, by Theorem 1, J¢(Ji) = I¢( Jo) = 
But 


1 
Ig(J,) + Ip(Jo) = 5, (Ale + AOla, - AP|c+ eee AG |c+ + AOlay 
+ AO|c- — AOla, — A®lg- — --» — A@le- — Alay] 


= & [ae - 520%) 
Thus, 
N N 
I(C) = S— Ie(C3) = — Tex). 
j=1 j=1 
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Theorem 3. Suppose that f € C'(E) where E is an open subset of R? 
and that E contains a cycle T of the system 


x = f(x). (1) 
It follows that I(T) = 1. 


Proof. At any point x € I, define the unit vector u(x) = f(x)/|f(x)|. 
Then /,(T) = J¢(I) and we shall show that J,(T) = 1. We can rotate and 
translate the axes so that [ is in the first quadrant and is tangent to the 
z-axis at some point Xo as in Figure 4. Let x(t) = (z(t), y(t))7 be the 
solution of (1) through the point x9 = (zo, yo)? at time t = 0. Then by 
normalizing the time as in Section 3.1, we may assume that the period of 
lI is equal to 1; i.e., 


l= {x € R? |x =x/(t),0<t <1}. 
Now for points (s, ¢) in the triangular region 
T = {(s,t) € R? |0<s<t< 1}, 
we define the vector field g by 
g(s,s) =u(x(s)), O<s<l 
g(0,1) = —u(xo) 


_ x(t) — x(s) 
Be) = Fe) — x(s) 
for 0 < s < t < 1 and (s,t) # (0,1); cf. Figure 4. It then follows that 
g is continuous on T and that g # 0 on T. Let O(s,t) be the angle that 
the vector g(s,f) makes with the z-axis. Then, assuming that the cycle 
I is positively oriented, ©(0,0) = 0 and since I is in the first quadrant, 
©(0,t) € [0,7] for 0 < t < 1, and therefore O(0,t) varies from 0 to m 
as t varies from 0 to 1. Similarly, it follows from the definition of g(s, ¢) 
that O(s,1) varies from 7 to 27 as s varies from 0 to 1. Let B denote the 
boundary of the region T. It then follows from Theorem 1 that [,(B) = 0. 
Thus the variation of (s,s) as s varies from 0 to 1 to 1 is 27. But this is 
exactly the variation of the angle that the vector u(x(s)) makes with the 
z-axis as s varies from 0 to 1. Thus /¢([.) = 1,([T) = 1. A similar argument 
yields the same result when I is negatively oriented. This completes the 
proof of Theorem 3. 


and 


Remark 1. For a separatrix cycle S of (1) such that the Poincaré map 
is defined on the interior or on the exterior of S, we can take a sequence 
of Jordan curves C, approaching S and, using the fact that we only have 
hyperbolic sectors on either the interior or the exterior of S, we can show 
that J¢(C,,) = 1. But for n sufficiently large, I(S) = I¢(Cn). Thus, I¢(S) = 
1. It should be noted that if the Poincaré map is not defined on either side 
of S, then J¢(S) may not be equal to one. 
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Figure 4. The vector field g on the triangular region T. 


Corollary 2. Under the hypotheses of Theorem 3, T contains at least one 
critical point of (1) on its interior. And, assuming that there are only a 
finite number of critical points of (1) on the interior of T, the sum of the 
indices at these critical points is equal to one. 


We next consider the relationship between the index of a critical point xo 
of (1) with respect to the vector field f and with respect to its linearization 
Df(xo9)x at Xo. The following lemma is useful in this regard. Its proof is 
left as an exercise; cf. Problem 3. 


Lemma 2. If v and w are two continuous vector fields defined on a Jor- 
dan curve C which never have opposite directions or are zero on C’, then 


Iy(C) = Iw(C). 


In proving the next theorem we write x = (z,y)? and 


f(x) = Df(0)x + g(x) = @ : iy) > (inte ) | 


We say that 0 is a nondegenerate critical point of (1) if det Df(0) 4 0, i-e., 
if ad — bc # 0; and we say that |g(x)| = o(r) as r — 0 if |g(x)|/r — 0 as 
r— 0. 


Theorem 5. Suppose that f € C!(E) where E is an open subset of R? 
containing the origin. If 0 is a nondegenerate critical point of (1) and 
lg(x)| = o(r) as r > 0, then Is(0) = I,(O) where v(x) = Df(0)x, the 
linearization of f at 0. 


This theorem is proved by showing that on a sufficiently small circle C 
centered at the origin the vector fields v and f are never in opposition and 
then applying Lemma 2. Suppose that v(x) and f(x) are in opposition at 
some point x € C’. Then at the point x € C, f+ sv = 0 for some s > 0. 
But f = v + g where g = f — v and therefore (1 + s)v = —g at the point 
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x € C; ie., (1 + s)?|v|? = |g?| at the point x € C. Now 
\v?| = r?[(acos 6 + bsin 6)? + (ccos6 + dsin6)*). 


And since ad — bc # 0, v = 0 only at x = 0. Thus, v is continuous and 
non-zero on the circle r = 1. Let 


m = min |v|. 
r=) 


Then m > 0 and since |v| is homogeneous in r we have |v| > mr for r > 0. 
It then follows that at the point x € C 


(1+ s)?m?r? < |g’. 


But if the circle C’ is chosen sufficiently small, this leads to a contradiction 
since we then have 


O<m< (1+ s)*m? < \g|2/r? 


and |g|?/r? — 0 as r — 0. Thus, the vector fields v and f are never in 
opposition on a sufficiently small circle C centered at the origin. It then 
follows from Lemma 2 that (0) = J,(0). 

Since the index of a linear vector field is invariant under a nonsingular 
linear transformation, the following theorem is an immediate consequence 
of Theorem 5 and computation of the indices of generic linear vector fields 
such as those in Example 1; cf. [C/L], p. 401. 


Theorem 6. Under the hypotheses of Theorem 5, I¢(0) is —1 or +1 ac- 
cording to whether the origin is or is not a topological saddle for (1) or 
equivalently according to whether the origin is or is not a saddle for the 
linearization of (1) at the origin. 


According to Theorem 6, the index of any nondegenerate critical point 
of (1) is either +1. What can we say about the index of a critical point xo 
of (1) when det Df(xo) = 0? The following theorem, due to Bendixson [B], 
answers this question for analytic systems. In Theorem 7, e denotes the 
number of elliptic sectors and h denotes the number of hyperbolic sectors 
of (1) at the origin. A proof of this theorem can be found on p. 511 in [A-I]. 


Theorem 7 (Bendixson). Let the origin be an isolated critical point of 
the planar, analytic system (1). It follows that 


10) =1+ (S5*). 


We see that for planar, analytic systems, this theorem implies the results 
of Theorem 6. It also implies that the number of elliptic sectors, e, and the 
number of hyperbolic sectors, h, have the same parity; i.e., e = h(mod 2). 
Note that the index of a saddle-node is zero according to this theorem; cf. 
Figure 3 in Section 2.11 of Chapter 2. 
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We next ontline the index theory for two-dimensional surfaces. By a two- 
dimensional surface S we mean a conipact, two-dimensional, differentiable 
manifold of class C?. First of all, let us define the index of S with respect to 
a vector field f on S; cf. Section 3.10. Suppose that the vector field f has only 
a finite number of critical points p;,..., Pm on S. Then for 7 = I....,m, 
each critical point p; € U, for some chart (U,.h;). The corresponding 
function f;: V, — R? then defines a C'-vector field on V, = h,(U;) C R?; 
cf. Section 3.10. The point q, = h;(p,) is then a critical point of the C'!- 
vector field f, on the open set V; C R?. The index of the critical point 
pj; € S with respect to the vector field f on S, I¢(p;), is then defined to be 
equal to the index [¢,(q,) of the critical point q, € V; with respect to the 
vector field f; on V, C R?. The inder of the surface S with respect to the 
vector field f on S is then defined to be equal to the sum of the indices at 
each of the critical points on S: 


vn 


IS) =~ Ie(p,). 
j=l 


We next show that the index of a surface S with respect to a vector 
ficld f on the surface is actually independent of the vector field f and only 
depends on the topology of the surface. In fact, [¢(S) = x(S), the Euler- 
Poincaré characteristic of the surface. In order to define the Euler Poincare 
characteristic y(S), we use the fact that any two-dimensional surface S can 
be decomposed into a finite number of curvilinear triangles. This is referred 
to as a triangulation of S. For a given triangulation of S, let v be the number 
of vertices, @ the mimber of edges, and T the number of triangles in the 
triangniation. The Euler Poincaré characteristic of S is then defined to be 
the integer 


xX(S) =T+r-—-. 


It can be shown that y(S) is a topological invariant which is independent 
of the triangulation and is related to the genus p of the surface S by the 
formula 


x(S) = 2(1 — p). (2) 


For orientable surfaces, the genus p is equal to the number of “holes” in 
the surface. For example p = 0 for the two-dimensional sphere S*, p = 1 
for the two-dimensional torns T?. and p = 2 for the two-dimensional an- 
chor ring. Is is easy to see that the tetrahedron triangulation of the sphere 
(where we project the surface of a tetrahedron onto S?) has v = 4 vertices, 
€ = 6 edges, and T = 4 triangles. Thus. y(S?) = 2. Any other triangula- 
tion of S? will yield the same result. for the Euler- Poincaré characteristic 
of S?. The torns T? can be triangulated to show that y(T?) = 0: ef. Prob- 
lem 5. Equation (2) for the characteristic also holds for non-orientable sur- 
faces such as the projective plane P and the Klein bottle A’. In this case. 
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the genus p = q/2 where the non-orientable surface S is topologically a 
two-dimensional sphere with g holes along whose boundaries the antipodal 
points are identified. Cf. the proof of Theorem 8 below. Thus, the charac- 
teristic of the projective plane x(P) = 1 and the characteristic of the Klein 
bottle y(A’) = 0: cf. Problem 5. 


Theorem 8 (The Poincaré Index Theorem). The index I¢(S) of a 
two-dimensional surface S relative to any C}-vector field £ on S with at 
most a finite number of critical points is independent of the vector field f 
and is equal to the Euler- Poincaré characteristic of S; 1.e. 


I¢(S) = x(S). 


We outline the proof of this interesting theorem which was first proved 
by Poincaré [P], p. 125, for orientable surfaces. The proof can be extended 
to non-orientable surfaces without difficulty. Following Gomory’s proof in 
Lefschetz {L], p. 367, we first prove that for any C!-vector field f on the 
sphere S? we have I,¢(S*) = 2 and that for any vector field f on the projec- 
tive plane P we have I-¢(P) = 1. We then use this information together with 
“surgery” on any other two-dimensional. topological surface S in order to 
coinplete the proof of the theorem. 

Let f be any vector field on the two-dimensional sphere S$? with a finite 
nuinber of critical points. At any regular point on S? we can construct a 
sufficiently small circle C such that the flow is essentially parallel inside and 
on C.. There will then be two points p and q on C where the vector field f is 
tangent to C’. These two points divide C into two circular arcs C and C2; 
i.e.. C = Cy +Co. The index of S? with respect to the vector field f, Ip(S*), 
is equal to the index of C' in the negative direction with respect to the 
vector field f: cf. Theorem 2. We now compute IJ(C’) where C is traversed 
in the negative direction. Let + be a smooth arc on S? joining p and q and 
containing no critical points of f. We can open out the punctured sphere, 
S* with the interior of C removed. and lay it out flat to obtain a disk 
with the flow on the boundary shown in Figure 5. The details of opening 
out a neighborhood of the point q and viewing it from the exterior of the 
punctured sphere are shown in Figure 6. Note that the arc y and the circle 
C' divide the punctured sphere into two regions R, and R2 and that on C 
and on y near C, the flow is out of R; and into R2. For points p’ and q’ 
on ¥ sufficiently near p and q, the vector field will be essentially parallel 
to the vector field at p and q respectively. On the arc p’q’ of + define v to 
be the vector field perpendicular to the arc at each point of 7 and pointing 
into R?. Also on the circle C and on the small arcs pp’ and qq’ define the 
vector field v = f/|f|. Then from Figure 5 we see that 


Iy(C; +pq)=1 and I,(Co+ Gp) =1. 
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p 
a7 
= . 
q 


Figure 5. The flow in a neighborhood of the circle C on the sphere S?. 


4 pp te ab 


R, Ro 


Figure 6. (a) A neighborhood of the point q € S. (b) Stretching the neigh- 
borhood. (c) The neighborhood as viewed from the interior of S? after 
opening out the punctured sphere. (d) The neighborhood as viewed from 
the exterior of S? after opening out the punctured sphere. 


But, for C traversed in the negative sense, we also have 
Ip(S?) = I¢(C) = Ip(C, + PG) + Ie(Co + GD) 
au = [Aelc, + A®l5q + ASlc, + ASlgple 
= = [A0lc,]e + = [de lpqle + [Ae lpqlv 
+ =-[A@lo,}e + = [A0lgple = =~ [A0lpqle 
s = [Aelc, + A@lpq + APlc, + ASlgply 


= Iy(C, + pq) + Iy(C2 + Gp) = 2 
since [A@|zaqle + [ASlaplr = 0 where [A@|,4]¢ denotes the change in the 
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angle © that the vector f makes with the z-axis as the arc A is traversed 
in the indicated direction. Thus, we have that IS?) = y(S?) = 2. 

Next, let f be any vector field on the projective plane P with a finite 
number of critical points. We take the unit disk Q = {x € R? | |x| < 1} 
with antipodal points identified as a model for P. Let A be the smooth 
surface which consists of two copies of Q, say Q) and Qe, joined at their 
boundaries, and let g be the vector field on A obtained by the continuous 
extension of the vector fields f on 2Q) and Qe» across the boundaries of 2, 
and Q»2. The vector field g on A will then have twice as many critical points 
as the vector field f on 2 and diametrically opposite critical points on A 
will have the same index. Thus, since A is topologically a two-dimensional 
sphere, we have 


InP) = 5 Ig(A) = 5 Ig(S?) = 1. 


It follows that I¢(P) = x(P) = 1. 

Having shown that I¢(S?) = 2, we can determine the index of any ori- 
entable surface S, with respect to a vector field f on S, using surgery. 
Suppose that S is an orientable surface of genus p, i.e., topologically S is 
a donut with p holes or a sphere with p handles; cf. Figure 7. And suppose 
that f is a vector field on S with a finite number of critical points. 


oe 


Figure 7. A surface of genus p. 


At each hole in S we cut out a section S;, 7 = 1,...,p, containing no 
critical points of f and shrink the boundaries of each of the sections S; to 
critical points P; and P;. Also, shrink the boundary of the surface 


to critical points, Q; and Qi, j = 1,...,p; ef. Figure 8. Let S’ and S) denote 
the resulting surfaces. We then have Ip(Q;) = Ip(P;) and Ir(Q;) = Is(P3) 
for j = 1,...,p. Thus since the surfaces Sj, 7 = 1,...,p, are topologically 
two-dimensional spheres, we have 


Ts(Q5) + Ie(Q5) = Ie(P3) + Ie(P;) = 2 


for j = 1,...,p. But S’ is also topologically a two-dimensional sphere and 
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therefore 
p 
Ie(S) = Ie(S’) — 9 [e(Q5) + 1e(Q5)] 
j=l 


= 2— 2p =x(S). 


This completes the proof of Theorem 8 for orientable surfaces. 


Qo Q 
aCe Po{ Sp) Pi CE) Fo 


Figure 8. The surfaces S’,S},...,S). 


Finally, suppose that S is a non-orientable surface of genus p and that f is 
a vector field with a finite number of critical points on S. Then topologically 
S is a two-dimensional sphere with g = 2p holes along whose boundaries 
the antipodal points have been identified; cf. [L], p. 370. We cut out the 
q cross-caps which are topologically equivalent to the projective plane P; 
and then shrink the boundaries of the q resulting holes to q critical points 
Q;,j=1,...,qg on S*. But 


1(Q;) = IP) = 1. 
Thus, 
q 
Ie(S) = Ie(S?) — > Te(Q5) 


j=1 
=2-—q=2-2p=y,(S). 


This completes the proof of the Poincaré Index Theorem. 


The next corollary is an immediate consequence of the Poincaré Index 
Theorem and Theorem 6; cf. [P], p. 121. 


Corollary 3. Suppose that f is an analytic vector field on an analytic, 
two-dimensional surface S of genus p and that f has only hyperbolic critical 
points; 1.e., isolated saddles, nodes and foci, on S. Then 


n+f—s=2(1-p) 


where n, f and s are the number of nodes, foci and saddles on S respectively. 
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Example 2. In Example 1 in Section 3.10 we described the flow on the 
Poincaré sphere determined by the planar system 


£=2 
y= -y. 
Cf. Figure 4 in Section 3.10. This simple planar system has a saddle at the 


origin. There are saddles at +(0,0,1) and nodes at +(1,0,0) and +(0, 1,0) 
on the Poincaré sphere. It follows from the above corollary that 


x(S?7) =n+f—-s=4-2=2 


as was to be expected. This same example also defines a vector field on the 
projective plane P, i.e., the vector field determined by the flow on P shown 
in Figure 5 in Section 3.10. We see that if the antipodal points of the disk 
shown in Figure 5 of Section 3.10 are identified, then we have a vector field 
on P with one saddle and two nodes and from the above corollary it follows 
that 
xX(P)=n+f—s=2-1=1 

as was to be expected. 


Remark 2. As in the above example, the global phase portrait of any 
planar polynomial system of odd degree describes a flow or a vector field 
f on the projective plane. Therefore, the sum of the indices of all of the 
finite critical points and infinite critical points (where we have identified 
the antipodal points on the boundary of the unit disk) with respect to the 
vector field f must be equal to one. 


Example 3. A model for the torus T? is the rectangle R with the opposite 
sides identified as in Figure 9. A flow on T? with two saddles and two nodes 
is defined by the flow on the rectangle A shown in Figure 9. The sum of the 
indices at the critical points of this flow is equal to zero, the Euler—Poincaré 
characteristic of T?. 


@® 
@ 


Figure 9. A flow on the torus T°. 


PROBLEM SET 12 
1. Use the index formula 


IC) = 1 f PdQ—-QdP 


2a Cc P2 + Q? 
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given at the beginning of this section to compute the indices I¢(C), 
Ig(C), In(C) and J,(C) for the vector fields f,g.h and k of Exam- 
ple 1. 


. Let Cq be a Jordan curve as described in the proof of Theorem 1, 


and let x9 = (Zo, yo)? be a point on Cg. Choose a coordinate system 
with the z-axis parallel to the vector f(xo) and in the direction of 
f(x). Then for f = (P,Q)? we have 


Q(to. Yo) =90 and P(z0, yo) = ko 


a positive constant. By the uniform continuity of P and Q in any 
conipact subset of E, the 6 > 0 in the proof of Theorem 1 can be 
chosen sufficiently small that 


—ko ko —ky ko 
5 < Q(z,y) < 5 and 5 < P(x, y) — ko < 5 


for all points (x,y) € Cy. Prove that this implies that 
AO/2n < 1/4 


as the point (.r, y) moves around Cy, in the positive direction. 


. Prove Lemma 2. First of all, define the family of vector fields 


v, =(1-—s)v+sw 


and show that v, # 0 and that v, is continuous for 0 < s < 1. Then 
use the continuity of J,,(C’) with respect to s and the fact that Jy, (C) 
is an integer to show that 


Iy(C) = Io (C) = Iv, (C) = Iw(C). 


. Use Bendixson’s Index Theorem, i.c., Theorein 7, to determine the 


indices of the degenerate critical points shown in Figures 2-5 in Sec- 
tion 2.11 of Chapter 2. 


(a) Use the triangulation shown on the top half of the torus T? in 
Figure 10 below, with an identical type of triangulation on the 
bottom half of T?, in order to show that x(T?) = 0. Describe a 
flow on T? with no critical points. 


(b) The Klein bottle /K is a non-orientable surface of genus p = 
q/2 = 1. The usual model for the Klein bottle is the two- 
dimensional sphere S? with two holes along whose boundaries 
the antipodal points are identified; cf. Figure 11. If we make a 
cut C’ between the two holes and lay the surface out flat, we 
have a rectangle R with the opposite sides identified as shown 
in Figure 11. For the vector field f defined by the uniform par- 
allel flow on R, shown in Figure 11. compute the index /-(K) 
and show that it is equal to x(/V). 
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aN 


Figure 10. A triangulation of the torus T?. 


Figure 11. A flow on the Klein bottle K. 


Remark 3. It follows from the index theory that the torus and the 
Klein bottle are the only two-dimensional surfaces on which there 
exist flows with no critical points. Furthermore, it can be shown that 
any flow on the Klein bottle with no critical points has a cycle. 


6. Show that the sum of the indices at all of the finite and infinite critical 
points of the vector fields on the Poincaré sphere S? determined by 
the global phase portraits in Figures 4, 7, 9 and 12 in Section 3.10 
are equal to two. Hint: Use Theorem 7 to determine the indices at 
the infinite critical points. Also, show that the sum of the indices at 
all of the critical points of the vector fields on the projective plane 
P determined by the global phase portraits in Figure 5 and those in 
Problem 3 in Section 3.10 are equal to one; cf. Remark 2. 


7. Find the index of the degenerate critical points shown in Figure 12 
below. 


8. In sketching the following vector fields or flows, be sure that they 
are continuous; i.e., no opposing vectors can appear in any small 
neighborhood on the surface. Use Theorem 7 to compute the indices. 
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Figure 12. Degenerate critical points. 


(a) Sketch a vector field or flow on the sphere S? 
(i) with one critical point and compute the index at this critical 
point; 
(ii) with two critical points and compute the indices at these 
critical points; 
(iii) with three critical points and compute the indices at these 
critical points. 
(b) Sketch a vector field or flow on the torus T? 
(i) with no critical points; 
(ii) with at least one critical point and compute the index at 
each critical point. 


(c) Sketch a vector field or flow on the anchor ring, i.e., an orientable 
surface of genus p = 2, and compute the sum of the indices at 
the critical points of this vector field. 

(d) Sketch a vector field or flow on an orientable surface of genus 
p = 3 and compute the sum of the indices at the critical points 
of this vector field. 

(e) Sketch a flow on the projective plane P 

(i) with one critical point 
(ii) with two critical points 
(f) Sketch a flow on the Klein bottle K with one critical point. 


9, Let z = x+y, Z = x — iy and show that the vector fields in the 
complex plane defined by 


z=z* and z=2* 
have unique critical points at z = 0 with indices k and —k respec- 
tively. Hint: Write z = Re(z*); y = Im(z*) and let z = re’. Sketch 
the phase portrait near the origin in those cases with indices +2 and 
+3. 


4 


Nonlinear Systems: 
Bifurcation Theory 


In Chapters 2 and 3 we studied the local and global theory of nonlinear 
systems of differential equations 


x = f(x) (1) 


with f € C'(E) where E is an open subset of R”. In this chapter we address 
the question of how the qualitative behavior of (1) changes as we change the 
function or vector field f in (1). If the qualitative behavior remains the same 
for all nearby vector fields, then the system (1) or the vector field f is said to 
be structurally stable. The idea of structural stability originated with An- 
dronov and Pontryagin in 1937. Their work on planar systems culminated 
in Peixoto’s Theorem which completely characterizes the structurally sta- 
ble vector fields on a compact, two-dimensional manifold and establishes 
that they are generic. Unfortunately, no such complete results are available 
in higher dimensions (n > 3). If a vector field f € C'(£) is not structurally 
stable, it belongs to the bifurcation set in C'(E). The qualitative structure 
of the solution set or of the global phase portrait of (1) changes as the 
vector field f passes through a point in the bifurcation set. In this chapter, 
we study various types of bifurcations that occur in C!-systems 


x = f(x, p) (2) 


depending on a parameter p € R (or on several parameters 4 € R™). In 
particular, we study bifurcations at nonhyperbolic equilibrium points and 
periodic orbits including bifurcations of periodic orbits from nonhyperbolic 
equilibrium points. These types of bifurcations are called local bifurcations 
since we focus on changes that take place near the equilibrium point or 
periodic orbit. We also consider global bifurcations in this chapter such as 
homoclinic loop bifurcations and bifurcations of limit cycles from a one- 
parameter family of periodic orbits such as those surrounding a center. 
This chapter is intended as an introduction to bifurcation theory and some 
of the simpler types of bifurcations that can occur in systems of the form 
(2). For the more general theory of bifurcations, the reader should consult 
Guckenheimer and Holmes [G/H], Wiggins [Wi], Chow and Hale [C/H], 
Golubitsky and Guillemin [G/G] and Ruelle (Rul. 
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Besides providing an introduction to the concept of structural stability 
and to bifurcation theory, this chapter also contains some interesting re- 
sults on the global behavior of one-parameter families of periodic orbits 
defined by C! or analytic systems depending on a parameter. In particu- 
lar, Duff’s theory for limit cycles of planar families of rotated vector fields 
is presented in Section 4.6 and Wintner’s Principle of Natural Termina- 
tion for one-parameter families of periodic orbits of analytic systems in 
R” is presented in Section 4.7. In Section 4.8, we see that for planar sys- 
tems a limit cycle typically bifurcates from a homoclinic loop or separatrix 
cycle of (2) as the parameter p is varied; however, in higher dimensions 
(n > 3), homoclinic loop bifurcations (or, more generally, bifurcations at 
a tangential homoclinic orbit) typically result in very wild or chaotic be- 
havior. Establishing the existence of homoclinic tangencies or transverse 
homoclinic orbits and the resulting chaotic behavior is a very difficult task. 
However, Melnikov’s Method which is presented in Sections 4.9-4.12 is one 
of the few analytic methods for studying homoclinic loop bifurcations and 
establishing the existence of transverse homoclinic orbits for perturbed dy- 
namical systems. We conclude this chapter with a discussion of the various 
types of bifurcations that occur in planar systems and apply this theory in 
order to determine all of the possible bifurcations and the corresponding 
phase portraits that occur in the class of bounded quadratic systems in R?. 


4.1 Structural Stability and Peixoto’s Theorem 


In this section, we present the concept of a structurally stable vector field 
or dynamical system and give necessary and sufficient conditions for a C!- 
vector field f on a compact two-dimensional manifold to be structurally 
stable. The idea of structural stability originated with Andronov and Pon- 
tryagin in 1937; cf. [A-II], p. 56. We say that f is a structurally stable 
vector field if for any vector field g near f, the vector fields f and g are 
topologically equivalent. Cf. Definition 2 in Section 3.1 of Chapter 3. The 
only concept that we need to make precise in this definition of structural 
stability is what it means for two C}-vector fields f and g to be close. 
If f € C!(E) where E is an open subset of R”, then the C!-norm of f 


Ilfll1 = sup |£(x)| + sup || Df(x)|| (1) 
x€E xe€E 


where | -| denotes the Euclidean norm on R” and || - || denotes the usual 
norm of the matrix Df(x) as defined in Section 1.3 of Chapter 1. The 
function || - ||, from C1(E) to R has all of the usual properties of a norm 
listed in Section 1.3 of Chapter 1. The set of functions in C!(E), bounded 
in the C!-norm, is a Banach space, i.e., a complete normed linear space. We 
shall use the C}-norm to measure the distance between any two functions 
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in C'(E). If K is a compact subset of E, then the C!-norm of f on K is 
defined by 


— / 
fll; = max |f(x)| + max |DE(x)|| < oo. (1" 


Definition 1. Let E be an open subset of R”. A vector field f € C!(E) is 
said to be structurally stable if there is an € > 0 such that for all g € C!(E) 
with 

lf -glli<e 


f and g are topologically equivalent on E; i.e., there is a homeomorphism 
H: EQ E which maps trajectories of 


x = f(x) (2) 


onto trajectories of 
x = g(x) (2’) 


and preserves their orientation by time. In this case, we also say that the 
dynamical system (2) is structurally stable. If a vector field f € C'(E) is 
not structurally stable, then f is said to be structurally unstable. If K is a 
compact subset of E and f € C'(E), then if we use the C!-norm (1’) in 
Definition 1, we say that the vector field f is structurally stable on K. 


Remark 1. If E = R", then the e-perturbations of f in the above defini- 
tion, i.e., the functions g € C!(E) satisfying ||f — gl]; < e, include the C’, 
€-perturbations of Guckenheimer and Holmes in Definition 1.7.1. on p. 38 
in [G/H]. Also if K is a compact subset of E and if g € C'(K) satisfies 


max |f(x) — g(x)| + max ||Df(x) — Dg(x)Il <«, 


then there exists a compact subset K of E containing K and a function 
g € C'(E) such that g(x) = g(x) for all x € K, g(x) = f(x) for all 
x € E~ K and ||f — gl; < €. Thus, in order to show that f € C!(R”) is 
not structurally stable on R”, it suffices to show that f is not structurally 
stable on some compact K Cc R” with nonempty interior. 


It was originally thought that structural stability was typical of any 
dynamical system modeling a physical problem. Consider, for example, 
a damped pendulum. If the mass, length or friction in the pendulum is 
changed by a sufficiently small amount, ¢, the qualitative behavior of the 
solution will remain the same; i.e., the global phase portraits of the two 
systems (2) and (2’) modeling the two pendula will be topologically equiv- 
alent. Thus, the dynamical system (2) modeling the physical system con- 
sisting of a damped pendulum is structurally stable. On the other hand, 
the dynamical system modeling an undamped pendulum in Example 1 in 
Section 2.14 of Chapter 2 is structurally unstable since the addition of any 
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small amount of friction, i.e., damping, will change the undamped, periodic 
motion seen in Figure 1 of Section 2.14 in Chapter 2 to a damped motion; 
i.e., the centers in Figure 1 will become stable foci. Of course, a frictionless 
pendulum is not physically realizable. If we were to only consider physi- 
cal problems which lead to systems of differential equations in R?, then 
we would not have to worry about arbitrarily small changes in the model 
leading to qualitatively different behavior of the system. However, there 
are higher dimensional systems (with n > 3) which are realistic models for 
certain physical problems (such as the three-body problem) and which are 
structurally unstable. Recently, many dynamical systems have been found 
which model physical problems and which have a strange attractor as part 
of their dynamics. These systems are not structurally stable and yet they 
are realistic models for certain physical systems; cf., e.g., [G/H], p. 259. 

We next define what is meant by a structurally stable vector field on 
an n-dimensional compact manifold M: If f is a C!-vector field on an n- 
dimensional, compact, differentiable manifold M, then for any (finite) atlas 
{U;,h;}%, for M we define the C)-norm of f on M as 


fll, = max fll 


where f;: V; — R® and for j = 1,...,m, V; = h,;(U;) C R” as in Sec- 
tion 3.10 of Chapter 3. Note that for different atlases for M we will get 
different norms on C!(M); however, all of these norms will be equivalent. 
Recall that two norms ||- ||, and || - ||, on a linear space L are said to be 
equivalent if there are positive constants A and B such that 
Al[xlla < [|xllb < Bllxlla 

for all x € L. Hence the resulting topologies on C!(M) will be equivalent. 
We say that two C!-vector fields f,g € C'(M) are topologically equivalent 
on M if there is a homeomorphism H: M — M which maps trajectories 
of (2) on M onto trajectories of (2’) on M and preserves their orientation 
by time. 


Definition 2. Let f be a C'-vector field on a compact, n-dimensional, 
differentiable manifold M. Then f € C'(M) is structurally stable on M if 
there is an € > 0 such that for all g € C'(M) with 


lf - gli <e, 
g is topologically equivalent to f. 


Remark 2. In 1962, Peixoto [22] gave a complete characterization of the 
structurally stable, C! vector fields on any compact, two-dimensional, dif- 
ferentiable manifold M (such as S*) and he showed that they form a dense, 
open subset of C!(M); cf. Theorem 3 below. However, it was later shown 
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that on any open, two-dimensional, differentiable manifold E (such as R?), 
there is a subset of C!(E) which is open in the C'-topology (defined by the 
C!-norm) and which consists of structurally unstable vector fields. Never- 
theless, in 1982, Kotus, Krych and Nitecki [16] showed how to control the 
behavior “at infinity” so as to guarantee the structural stability of a vec- 
tor field on any two-dimensional, differentiable manifold under “strong C’- 
perturbation” and they gave a complete characterization of the structurally 
stable vector fields on R?. Cf. Theorem 4 below. 


Example 1. The vector field 


vo-(2) 


on R? is not structurally stable on any compact set K C R? containing 
the origin on its interior. To see this we let K be any compact subset of R? 
which contains the origin on its interior and show that f is not structurally 
stable on K. Let || - ||, denote the C'-norm on K and define the vector field 


_ (yt 
Then 
If — gly = [ol(max |x| +1) 
and if d is the diameter of K, i.e. if 


d= max |x — 
max. |x y|, 


it follows for all e > 0 that if we choose || = ¢/(d+2) then ||f—g||, < ¢. The 
phase portraits for the system x = g(x) are shown in Figure 1. Clearly f is 
not topologically equivalent to g; cf. Problem 1. Thus f is not structurally 
stable on R?. The number p = 0 is called a bifurcation value for the system 
X = g(x). 


Example 2. The system 
£ = —-yt+2(r? + y* - 1)? 
y=rty(2?+y?-1)? 
is structurally unstable on any compact subset K C R? which contains the 
unit disk on its interior. This can be seen by considering the system 
#=—y+a2[(2? +y? -1)?- 4p] 
y=rtyl(r?+y?-1)?-y 
which is ¢-close to the above system if |u| = e/(d + 2) where d is the 
diameter of K. But writing this latter system in polar coordinates yields 


Ferl(r?-1)?-p] 


d=1. 
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p<O 


p>Oo 


Figure 1. The phase portraits for the system x = g(x) in Example 1. 
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Hence, we have the phase portraits shown in Figure 2 below; and the 
above system with pp = 0 is structurally unstable; cf. Problem 2. The 
number yp = 0 is called a bifurcation value for the above system and for 
pp = 0 this system has a limit cycle of multiplicity two represented by 
y(t) = (cost, sint)?. 

Note that for ~ = 0, the origin is a nonhyperbolic critical point for the 
system in Example 1 and +(t) is a nonhyperbolic limit cycle of the system in 
Example 2. In general, dynamical systems with nonhyperbolic equilibrium 
points and/or nonhyperbolic periodic orbits are not structurally stable. 
This does not mean that dynamical systems with only hyperbolic equilib- 
rium points and periodic orbits are structurally stable; cf., e.g., Theorem 3 
below. 

Before characterizing structurally stable planar systems, we cite some 
results on the persistance of hyperbolic equilibrium points and periodic 
orbits; cf., e.g., [H/S], pp. 305-312. 


Theorem 1. Let f € C'(E) where E is an open subset of R" containing 
a hyperbolic critical point xo of (2). Then for any € > 0 there is a6 > 0 
such that for all g € C}(E) with 


lf — gl <6 


there exists a yo € Ne(Xo) such that yo is a hyperbolic critical point of (2'); 
furthermore, Df(xo) and Dg(yo) have the same number of eigenvalues with 
negative (and positive) real parts. 


Theorem 2. Let f € C'(E) where E is an open subset of R” containing 
a hyperbolic periodic orbit [ of (2). Then for any ¢ > 0 there is a6 > 0 
such that for all g € C'(E) with 


lf — glli < 6 


there exists a hyperbolic periodic orbit I’ of (2') contained in an €-neigh- 
borhood of T; furthermore, the stable manifolds W*(T) and W%(I’), and 
the unstable manifolds W“([T) and W“(T"), have the same dimensions. 


One other important result for n-dimensional systems is that any linear 
system 


x = Ax 


where the matrix A has no eigenvalue with zero real part is structurally 
stable in R”. Besides nonhyperbolic equilibrium points and periodic orbits, 
there are two other types of behavior that can result in structurally unstable 
systems on two-dimensional manifolds. We illustrate these two types of 
behavior with some examples. 
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pe<O 


pO 


p>o 


Figure 2. The phase portraits for the system in Example 2. 
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p<O 


yO 


p>o 


Figure 3. The phase portraits for the system in Example 3. 
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Example 3. Consider the system 


r=y 

y=pytc—-2’. 
For » = 0 this is a Hamiltonian system with Hamiltonian H(z, y) = (y? — 
z*)/2+ 24/4. The level curves for this function are shown in Figure 3. We 
see that for » = 0 there are two centers at (+1, 0) and two separatrix cycles 
enclosing these centers. For » = 0 this system is structurally unstable on 
any compact subset K C R? containing the disk of radius 2 because the 
above system is €-close to the system with p = 0 if |u| = e/(d+2) where d is 
the diameter of K. Also, the phase portraits for the above system are shown 
in Figure 3 and clearly the above system with p £ 0 is not topologically 
equivalent to that system with yu = 0; cf. Problem 3. 


In Example 3, not only does the qualitative behavior near the nonhyper- 
bolic critical points (+1, 0) change as p varies through pz = 0, but also there 
are no separatrix cycles for 4 # 0; i.e., separatrix cycles and more generally 
saddle-saddle connections do not persist under small perturbations of the 
vector field. Cf. Problem 4 for another example of a planar system with a 
saddle-saddle connection. 


Definition 3. A point x € E (or x € M) is a nonwandering point of the 
flow , defined by (2) if for any neighborhood U of z and for any T > 0 
there is a t > T such that 


$(U)NU FO. 


The nonwandering set 2) of the flow @, is the set of all nonwandering points 
of ¢, in E (or in M). Any point x € E ~ 2 (or in M ~ Q) is called a 
wandering point of ¢,. 


Equilibrium points and points on periodic orbits are examples of non- 
wandering points of a flow and for a relatively-prime, planar, analytic flow, 
the only nonwandering points are critical points, points on cycles and points 
on graphics that belong to the w-limit set of a trajectory or the limit set 
of a sequence of periodic orbits of the flow (on R? or on the Bendixson 
sphere; cf. Problem 8 in Section 3.7). This is not true in general as the next 
example shows; cf. Theorem 3 in Section 3.7 of Chapter 3. 


Example 4. Let the unit square S with its opposite sides identified be a 
model for the torus and let (z, y) be coordinates on S which are identified 
(mod 1). Then the system 


r= WwW} 
Yy = we 
defines a flow on the torus; cf. Figure 4. The flow defined by this system is 
given by 
,(Z0, yo) = (wit + Zo, wat + yo)’. 
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If w,/we is irrational, then all points lie on orbits that never close, but 
densely cover S or the torus. If w/w is rational then all points lie on 
periodic orbits. Cf. Problem 2 in Section 3.2 of Chapter 3. In either case all 
points of T? are nonwandering points, i.e., 2 = T?. And in either case, the 
system is structurally unstable since in either case, there is an arbitrarily 
small constant which, when added to w), changes one case to the other. 


Figure 4. A flow on the unit square with its opposite sides identified and 
the corresponding flow on the torus. 


We now state Peixoto’s Theorem [22], proved in 1962, which completely 
characterizes the structurally stable C!-vector fields on a compact, two- 
dimensional, differentiable manifold M. 


Theorem 3 (Peixoto). Let f be a C'-vector field on a compact, two- 
dimensional, differentiable manifold M. Then f is structurally stable on M 
if and only if 


(i) the number of critical points and cycles is finite and each is hyperbolic; 
(ii) there are no trajectories connecting saddle points; and 


(iii) the nonwandering set Q consists of critical points and limit cycles 
only. 


Furthermore, if M is orientable, the set of structurally stable vector fields 
in C!(M) is an open, dense subset of C'(M). 


If the set of all vector fields f € C7™(M), with r > 1, having a certain 
property P contains an open, dense subset of C7(M), then the property P 
is called generic. Thus, according to Peixoto’s Theorem, structural stability 
is a generic property of the C! vector fields on a compact, two-dimensional, 
differentiable manifold M. More generally, if V is a subset of C™(M) and 
the set of all vector fields f € V having a certain property P contains an 
open, dense subset of V, then the property P is called generic in V. 

If the phase space is planar, then by the Poincaré-Bendixson Theorem 
for analytic systems, the only possible limit sets are critical points, limit 
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cycles and graphics and if there are no saddle-saddle connections, graphics 
are ruled out. The nonwandering set 22 will then consist of critical points 
and limit cycles only. Hence, if f is a vector field on the Poincaré sphere 
defined by a planar polynomial vector field as in Section 3.10 of Chapter 3, 
we have the following corollary of Peixoto’s Theorem and Theorem 3 in 
Section 3.7 of Chapter 3. 


Corollary 1. Let f be a vector field on the Poincaré sphere defined by the 
differential equation 


dX dY dZ 
X Y 2Z)=0 
P* Q* O 


where 


P*(X,Y,Z) = Z™P(X/Z,Y/Z), 
Q"(X,Y,Z) = 2Z"Q(X/Z,Y/Z), 


and P and Q are polynomials of degree m. Then f is structurally stable on 
S? if and only if 


(i) the number of critical points and cycles is finite and each is hyperbolic, 
and 


(ii) there are no trajectories connecting saddle points on S?. 


This corollary gives us an easy test for the structural stability of the 
global phase portrait of a planar polynomial system. In particular, the 
global phase portrait will be structurally unstable if there are nonhyperbolic 
critical points at infinity or if there is a trajectory connecting a saddle on 
the equator of the Poincaré sphere to another saddle on S?. It can be shown 
that if the polynomial vector field f in Corollary 1 is structurally stable on 
S?, then the corresponding polynomial vector field (P,Q)? is structurally 
stable on R? under “strong C!-perturbations”. We say that a C!-vector 
field f is structurally stable on R? under strong C!-perturbations (or that 
it is structurally stable with respect to the Whitney C!-topology on R?) if 
it is topologically equivalent to all C!-vector fields g satisfying 


|f(x) — g(x)| + [|Df(x) - Dg(x)|] < e(x) 


for some continuous, strictly positive function €(x) on R?. The fact that 
structural stability of the polynomial vector field f on S? in Corollary 1 im- 
plies that the corresponding polynomial vector field (P,Q)? is structurally 
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stable on R? under strong C!-perturbations follows from Corollary 1 and 
the next theorem proved in [16]; cf. Theorem 3.1 in [56]. Also, it follows 
from Theorem 23 in [A-II] and Theorem 4 below that structural stability 
of a polynomial vector field f on R? under strong C!-perturbations implies 
that f is structurally stable on any bounded region of R?; cf. Definition 10 
in [A-II]. (The converses of the previous two statements are false as shown 
by the examples below.) In order to state the next theorem, we first define 
the concept of a saddle at infinity as defined in [56]. 


Definition 4. A saddle at infinity (SAI) of a vector field f defined on 
R? is a pair (Tp.Tq) of half-trajectories of f, each escaping to infinity, 
such that there exist sequences p, — p and t, — oo with $(tn, Pn) - q 
in R?. lp is called the stable separatrix of the SAI and 'g the unstable 
separatrix of the SAI. A saddle connection is a trajectory T of f with 
lI =I+uTI- where I* is a stable separatrix of a saddle or of a SAI while 
[— is a separatrix of a saddle or of a SAI. 

If we let W+(f) denote the union of all trajectories containing a stable or 
unstable separatrix of a saddle or SAI of f, then there is a saddle connection 
only if W+(f) NW (f) £ @. 


Theorem 4 (Kotus, Krych and Nitecki). A polynomial vector field is 
structurally stable on R? under strong C'-perturbations iff 


(i) all of its critical points and cycles are hyperbolic and 


(ii) there are no saddle connections (where separatrices of saddles at in- 
finity are taken into account). 


Furthermore, there is a dense open subset of the set of all mth-degree poly- 
nomials, every element of which is structurally stable on R? under strong 
C' -perturbations. 


It is also shown in Proposition 2.3 in [56] that (i) and (ii) in Theorem 4 
imply that the nonwandering set consists of equilibrium points and periodic 
orbits only. As in [56], we have stated Theorem 4 for polynomial vector 
fields on R?; however, it is important to note that Theorems A and B in 
[16] give necessary and sufficient conditions for any C' vector field on R? to 
be structurally stable on R? under strong C'-perturbations and sufficient 
conditions for the structural stability of any C! vector field on a smooth 
two-dimensional open surface (i.e., a smooth two-dimensional differentiable 
manifold without boundary which is metrizable but not compact) under 
strong C'-perturbations. 
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The following example has a saddle connection between two saddles at 
infinity on S? and also a saddle connection according to Definition 4. It 
is therefore not structurally stable on S?, according to Corollary 1, or on 
R? under strong C!-perturbations, according to Theorem 4; however, it is 
structurally stable on any bounded region of R?, according to Theorem 23 
in [A-II]. 

Example 5. The cubic system 
t=1-y° 
y=ryt+y 


has the global phase portrait shown below: 


Clearly the trajectory [ connects the two saddles at (+1,0,0) on the 
Poincaré sphere. And if we let p and q be any two points on I’, then (Ts TT) 
is a saddle at infinity and (for p to the left of gon) fT = TSU isa saddle 
connection according to Definition 4. We also note that W*(f)NW~ (f) =L 
for the vector field given in this example. 


The next example due to Chicone and Shafer, cf. (2.4) in [16], has a sad- 
dle connection according to Definition 4 and it is therefore not structurally 
stable on R? under strong C!-perturbations according to Theorem 4; al- 
though, it is structurally stable on any bounded region of R? according 
- to Theorem 23 in (A-II]. And since the corresponding vector field f in 
Corollary 1 has a nonhyperbolic critical point at (0,+1,0) on S?, f is not 
structurally stable on S?. 
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Example 6. The quadratic system 


L= 2zry 
y= Ary -—2?+y*?+1 


has the global phase portrait shown below: 


Let p; € [;. Then (Tp, Tp.) and (Tp. lps) are two saddles at infinity 
and [2 = lp U Ip, is a saddle connection according to Definition 4. We 
also note that W+(f) NW (f) = (CT; Ul2) N([2UT3) =Te2 for the vector 
field f given in this example. 


The next example, which is (2.6) in [16], gives us a polynomial vector field 
which is structurally stable on R? under strong C!-perturbations according 
to Theorem 4, but whose projection onto S? is not structurally stable on 
S? according to Corollary 1 since there is a nonhyperbolic critical point at 
(0, 1,0) on S?. 


Example 7. The cubic system 


tor -2z 


y= 427-1 
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has the global phase portrait shown below: 


This system has no critical points or cycles in R?. Let p; € Tj. Then 
(Tp, Tp.) and (Tp,.lp,) are saddles at infinity, but there is no saddle 
connection since Wt(f) N W~(f) = (CT; Ul3) NT2 = @ for the vector field 
f in this example. 

Shafer [56] has also given sufficient conditions for a polynomial vector 
field f € Pm to be structurally stable with respect to the coefficient topol- 
ogy on P,, (where P,, denotes the set of all polynomial vector fields of 
degree less than or equal to m on R?). It follows from Corollary 1 and the 
results in [56] that structural stability of the projection of the polynomial 
vector field on the Poincaré sphere implies structural stability of the poly- 
nomial vector field with respect to the coefficient topology on P,, which, in 
turn, implies structural stability of the polynomial vector field with respect 
to the Whitney C’-topology. 

In 1937 Andronov and Pontryagin showed that the conditions (i) and (ii) 
in Corollary 1 are necessary and sufficient for structural stability of a C!- 
vector field on any bounded region of R?; cf. Definition 10 and Theorem 23 
in [A-II]. And in higher dimensions, (i) together with the condition that the 
stable and unstable manifolds of any critical points and/or periodic orbits 
intersect transversally (cf. Definition 5 below) is necessary and sufficient 
for structural stability of a C!-vector field on any bounded region of R” 
whose boundary is transverse to the flow. However, there is no counterpart 
to Peixoto’s Theorem for higher dimensional compact manifolds. 


For a while, it was thought that conditions analogous to those in Peixoto’s 
Theorem would completely characterize the structurally stable vector fields 
on a compact, n-dimensional, differentiable manifold; however, this proved 
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not to be the case. In order to formulate the analogous conditions for higher 
dimensional systems, we need to define what it means for two differentiable 
manifolds M and N to intersect transversally, i.e., nontangentially. 


Definition 5. Let p be a point in R”. Then two differentiable manifolds 
M and N in R” are said to intersect transversally at pe MON if T,Me 
TpN = R" where T,M and T,N denote the tangent spaces of M and 
N respectively at p. M and N are said to intersect transversally if they 
intersect transversally at every point pe MNN. 


Definition 6. A Morse-Smale system is one for which 


(i) the number of equilibrium points and periodic orbits is finite and 
each is hyperbolic; 


(ii) all stable and unstable manifolds which intersect do so transversally; 
and 


(iii) the nonwandering set consists of equilibrium points and periodic or- 
bits only. 


It is true that Morse-Smale systems on compact n-dimensional differ- 
entiable manifolds are structurally stable, but the converse is false in di- 
mensions n > 3. As we shall see, there are structurally stable systems with 
strange attractors which are part of the nonwandering set. In dimensions 
n > 3, the structurally stable vector fields are not generic in C!(M). In fact, 
there are nonempty open subsets in C'(M) which consist of structurally 
unstable vector fields. Smale’s work on differentiable dynamical systems 
and his construction of the horseshoe map were instrumental in proving 
that the structurally stable systems are not generic and that not all struc- 
turally stable systems are Morse-Smale; cf. [G/H], Chapter 5. 

In the remainder of this chapter we consider the various types of bifur- 
cations that can occur at nonhyperbolic equilibrium points and periodic 
orbits as well as the bifurcation of periodic orbits from equilibrium points 
and homoclinic loops. We also give a brief glimpse into what can happen 
at homoclinic loop bifurcations in higher dimensions (n > 3). 


PROBLEM SET 1 


1. (a) In Example 1 show that ||f — gl]; = |u|(maxxex |x| + 1). 
(b) Show that for 4 4 0 the systems 
b=-y yg Fe nu tes 

y=2 y=xrt py 


are not topologically equivalent. Hint: Let @, and 2, be the 
flows defined by these two systems and assume that there is a 
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2: 


(a) 
(b) 


(a) 


(b) 
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homeomorphism H: R? — R? and a strictly increasing, con- 
tinuous function t(7) mapping R onto R such that ¢,,) = 
How, oH. Use the fact that limi... ¢,(1,0) # 0 and that 
for p < 0, limpoo W,(x) = 0 for all x € R? to arrive at a con- 
tradiction. 


In Example 2 show that ||f — g]|1 = |u|(maxxex |x| + 1). 


Show that the systems in Example 2 with » = O and p # 0 
are not topologically equivalent. Hint: As in Problem 1, use the 
fact that for |x| < 1 


| Jim $4(x)| =1 if p=0 
t—0o 
and 
| Jim (0) =o if p<0 
t—-0co 
to arrive at a contradiction. 
In order to justify the phase portraits in Figure 3, show that the 
origin in Example 3 is a saddle and for p < 0 (or p > 0) the 
critical points (+1,0) are stable (or unstable) foci; for uw # 0, 


use Bendixson’s Criteria to show that there are no cycles; and 
then use the Poincaré-Bendixson Theorem. 


Show that the system in Example 3 with p» = 0 is not structurally 
stable on the compact set K = {x € R? | |x| < 2}. Hint: As in 
Problems 1 and 2 use the fact that 


jim @,(V2,0) = (0,0) for p =0 
and 

jim w,(V2,0) = (1,0) for p <0 
to arrive at a contradiction. 


Draw the (local) phase portrait for the system 
z=2(1-2) 
y = —y(1 —2z). 
Show that this system (which has a saddle-saddle connection) is 


not structurally stable. Hint: For p = ¢/(d + 2), show that the 
system 


z=2(1-72) 

y = —y(1 — 22) + pa 
is e-close to the system in part (a) on any compact set K Cc R? 
of diameter d. Sketch the (local) phase portrait for this system 
with > O and assuming that the systems in (a) and (b) are 


topologically equivalent for u # 0, arrive at a contradiction as 
in Problems 1-3. 
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5. Determine which of the global phase portraits in Figure 12 of Sec- 
tion 3.10 are structurally stable on S? and which are structurally 
stable on R? under strong C!-perturbations. 


6. ((G/H], p. 42). Which of the following differential equations (consid- 
ered as systems in R?) are structurally stable? Why or why not? 


(a) €+2r+2=0 

(b) #+z2+2°=0 

(c) £+sinz =0 

(d) #+27+2=0. 

7. Construct the (local) phase portrait for the system 
E=—-yt+ zy 
y=2rt(z? —y’)/2 
and show that it is structurally unstable. 


8. Determine the nonwandering set 2 for the systems in Example 2 and 
Example 3 (for zp < 0, w =0, and p > 0). 


9. Describe the nonwandering set on the Poincaré sphere for the global 
phase portraits in Problem 10 of Section 3.10 of Chapter 3. 


10. Describe the nonwandering set for the phase portraits shown in Fig- 
ure 5 below: 


S) ED 
JX. XE 


Figure 5. Some planar phase portraits with graphics. 
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4.2 Bifurcations at Nonhyperbolic Equilibrium 
Points 


At the beginning of this chapter we mentioned that the qualitative behavior 
of the solution set of a system 


xX = f(x, 1), (1) 


depending on a parameter y € R, changes as the vector field f passes 
through a point in the bifurcation set or as the parameter p varies through a 
bifurcation value jp. A value po of the parameter p in equation (1) for which 
the C!-vector field f(x, zo) is not structurally stable is called a bifurcation 
value. We shall assume throughout this section that f € C'(E x J) where 
E is an open set in R” and J C R is an interval. 

We begin our study of bifurcations of vector fields with the simplest 
kinds of bifurcations that occur in dynamical systems; namely, bifurcations 
at nonhyperbolic equilibrium points. In fact, we begin with a discussion of 
various types of critical points of one-dimensional systems 


t= f(z, p) (1’) 


with z € R and pw E R. The three simplest types of bifurcations that occur 
at a nonhyperbolic critical point of (1') are illustrated in the following 
examples. 


Example 1. Consider the one-dimensional system 


z= p—2’. 

For » > 0 there are two critical points at z = +,/u; Df(z,pu) = —2z, 
Df (+/H, u) = F2,/p; and we see that the critical point at z = ,/p is stable 
while the critical point at z = —,/p is unstable. (We continue to use D for 
the derivative with respect to z and the symbol Df (z, 1) will stand for the 
partial derivative of the function f(z, 4) with respect to z.) For up = 0, there 
is only one critical point at z = 0 and it is a nonhyperbolic critical point 
since Df(0,0) = 0; the vector field f(x) = —z? is structurally unstable; 
and p = 0 is a bifurcation value. For yz < 0 there are no critical points. 
The phase portraits for this differential equation are shown in Figure 1. For 
ps > 0 the one-dimensional stable and unstable manifolds for the differential 
equation in Example 1 are given by W*°(,/) = (—,/p, 00) and W*(—,/z) = 
(—oo, /#). And for 4 = 0 the one-dimensional center manifold is given 
by W°(0) = (—oo,00). All of the pertinent information concerning the 
bifurcation that takes place in this system at 4 = 0 is captured in the 
bifurcation diagram shown in Figure 2. The curve pz — xz” = 0 determines 
the position of the critical points of the system, a solid curve is used to 
indicate a family of stable critical points while a dashed curve is used to 
indicate a family of unstable critical points. This type of bifurcation is 
called a saddle-node bifurcation. 
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——~<——__—. x —<—_o—_<«— xX —~<—-o—>—__o-—-<— X 


Figure 1. The phase portraits for the differential equation in Example 1. 


Figure 2. The bifurcation diagram for the saddle-node bifurcation in Ex- 
ample 1. 


Example 2. Consider the one-dimensional system 


i= px — x’, 

The critical points are at zx = 0 and x = w. For p = 0 there is only one 
critical point at z = 0 and it is nonhyperbolic since Df (0,0) = 0; the vector 
field f(z) = —x? is structurally unstable; and yp = 0 is a bifurcation value. 
The phase portraits for this differential equation are shown in Figure 3. 
For pp = 0 we have W‘°(0) = (—00, 00); the bifurcation diagram is shown in 
Figure 4. We see that there is an exchange of stability that takes place at 
the critical points of this system at the bifurcation value py = 0. This type 
of bifurcation is called a transcritical bifurcation. 
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Gm Q—— Han iewm jf —— =e —= SO —E— XK 


p<O0 p=0 up>d 


Figure 3. The phase portraits for the differential equation in Example 2. 


Figure 4. The bifurcation diagram for the transcritical bifurcation in Ex- 
ample 2. 


Example 3. Consider the one-dimensional system 


r= pr— x, 

For p > 0 there are critical points at z = 0 and at z = +,/p. For p < 
0, z = 0 is the only critical point. For » = 0 there is a nonhyperbolic 
critical point at z = 0 since Df(0,0) = 0; the vector field f(x) = —2° is 
structurally unstable; and p = 0 is a bifurcation value. The phase portraits 
are shown in Figure 5. For p < 0 we have W4(0) = (—00, 00); however, for 
pp = 0 we have W*(0) = @ and W‘(0) = (0, 00). The bifurcation diagram 
is shown in Figure 6 and this type of bifurcation is aptly called a pitchfork 
bifurcation. 


—— >» ——4-————— X — o_o >= x 


p <0 p>o 


Figure 5. The phase portraits for the differential equation in Example 3. 
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x 


Figure 6. The bifurcation diagram for the pitchfork bifurcation in Exam- 
ple 3. 


While the saddle-node, transcritical and pitchfork bifurcations in Exam- 
ples 1-3 illustrate the most important types of bifurcations that occur in 
one-dimensional systems, there are certainly many other types of bifurca- 
tions that are possible in one-dimensional systems; cf., e.g., Problems 1 and 
2. If Df(0,0) = --- = D("-) f(0,0) = 0 and D™ f(0, 0) # 0, then the one- 
dimensional system (1’) is said to have a critical point of multiplicity m at 
x = 0. In this case, at most m critical points can be made to bifurcate from 
the origin and there is a bifurcation which causes exactly m critical points 
to bifurcate from the origin. At the bifurcation value yz = 0, the origin is a 
critical point of multiplicity two in Examples 1 and 2; it is a critical point 
of multiplicity three in Example 3; and it is a critical point of multiplicity 
four in Problem 1. 

If f(xo, Ho) = Df (zo, uo) = 0, then zo is a nonhyperbolic critical point 
of the system (1’) with = po and po is a bifurcation value of the system 
(1’). In this case, the type of bifurcation that occurs at the critical point 
Z = Zo at the bifurcation value yz = po in the one-dimensional system (1’) 
is determined by which of the higher order derivatives 


d”™ f (x0, Ho) 
Oxi Opk ° 


with m > 2, vanishes. This is also true in a sense for higher dimensional 
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systems (1) and we have the following theorem proved by Sotomayor in 
1976; cf. [(G/H], p. 148. It is assumed that the function f(x, 2) is sufficiently 
differentiable so that all of the derivatives appearing in that theorem are 
continuous on R”® x R. We use Df to denote the matrix of partial derivatives 
of the components of f with respect to the components of x and f,, to denote 
the vector of partial derivatives of the components of f with respect to the 
scalar p. 


Theorem 1 (Sotomayor). Suppose that f(xo, uo) = 0 and that thenxn 
matriz A = Df(x0, uo) has a simple eigenvalue \ = 0 with eigenvector v 
and that A? has an eigenvector w corresponding to the eigenvalue \ = 
0. Furthermore, suppose that A has k eigenvalues with negative real part 
and (n —k — 1) eigenvalues with positive real part and that the following 
conditions are satisfied 


w"f,,(xo, #0) #0, w"[D?£(xo, Ho)(v, v)] # 0. (2) 


Then there is a smooth curve of equilibrium points of (1) in R” x R passing 
through (Xo, uo) and tangent to the hyperplane R” x {uo}. Depending on 
the signs of the expressions in (2), there are no equilibrium points of (1) 
near Xo when pt < po (or when pu > po) and there are two equilibrium points 
of (1) near xq when p > uo (or when p< poo). The two equilibrium points 
of (1) near xo are hyperbolic and have stable manifolds of dimensions k and 
k+1 respectively; i.e., the system (1) experiences a saddle-node bifurcation 
at the equilibrium point xo as the parameter ys passes through the bifurcation 
value p = Uo. The set of C™-vector fields satisfying the above condition is 
an open, dense subset in the Banach space of all C™, one-parameter, vector 
fields with an equilibrium point at xo having a simple zero eigenvalue. 


The bifurcation diagram for the saddle-node bifurcation in Theorem 1 is 
given by the one shown in Figure 2 with the z-axis in the direction of the 
eigenvector v. (Actually, the diagram in Figure 2 might have to be rotated 
about the x or yu axes or both in order to obtain the correct bifurcation 
diagram for Theorem 1.) 

If the conditions (2) are changed to 


w’ £,,(Xo, Ho) = 0, 
w? [Dfy(xo, uo)v] #0 and (3) 
w’ [D*f (xo, Ho)(v, v)] F 0, 


then the system (1) experiences a transcritical bifurcation at the equilib- 
rium point xo as the parameter yu varies through the bifurcation value 
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jt = po and the bifurcation diagram is given by Figure 4 with the z-axis in 
the direction of the eigenvector v. And if the conditions (2) are changed to 


w’ f,,(xo, Ho) = 0, w’ [Dfu (xo, Ho)V] # 0, 


Ti n2 Tin3 (4) 

w’ [D°f(x0, uo)(v, v)] = 0 and w’ [D°f(xo, 40) (Vv, v, v)] 4 0, 
then the system (1) experiences a pitchfork bifurcation at the equilibrium 
point Xo as the parameter p varies through the bifurcation value u = po 
and the bifurcation diagram is given by Figure 6 with the z-axis in the 
direction of the eigenvector v. 

Sotomayor’s theorem also establishes that in the class of C™, one-para- 
meter, vector fields with an equilibrium point having one zero eigenvalue, 
the saddle-node bifurcations are generic in the sense that any such vec- 
tor field can be perturbed to a saddle-node bifurcation. Transcritical and 
pitchfork bifurcations are not generic in this sense and further conditions 
on the one-parameter family of vector fields f(x, 4) are required before (1) 
can experience these types of bifurcations. 

We next present some examples of saddle-node, transcritical and pitch- 
fork bifurcations at nonhyperbolic critical points of planar systems which, 
once again, illustrate that the qualitative behavior near a nonhyperbolic 
critical point is determined by the behavior of the system on the center 
manifold; cf. Examples 4-6 and Examples 1-3 above. 


Example 4. Consider the planar system 


z£=p—-2? 


y=-y. 


In the notation of Theorem 1, we have 


0 -1l 


£,(0,0) = (6) 


v = w = (1,0)7, w7f,,(0,0) = 1 and w7[D7£(0,0)(v, v)] = —2. There 
is a saddle-node bifurcation at the nonhyperbolic critical point (0, 0) at 
the bifurcation value u = 0. For p < 0 there are no critical points. For 
p = 0 there is a critical point at the origin and, according to Theorem 1 
in Section 2.11 of Chapter 2, it is a saddle-node. For » > 0 there are 
two critical points at (+,/7,0); (./#,0) is a stable node and (—,/p,0) is 
a saddle. The phase portraits for this system are shown in Figure 7 and 
the bifurcation diagram is the same as the one in Figure 2. Note that the 


A= Df(0,0) = k | 
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z-axis is in the v direction and that it is an analytic center manifold of the 
nonhyperbolic critical point 0 for p = 0. 


AL, 


pu<0 ps0 B>O 
Figure 7. The phase portraits for the system in Example 4. 


Remark. It follows from Lemma 2 in Section 3.12 that the index of a closed 
curve C’ relative to a vector field f (where f has no critical points on C) 
is preserved under small perturbations of the vector field. For example, we 
see that for sufficiently small yp, the index of a closed curve containing the 
origin on its interior is zero for any of the vector fields shown in Figure 7. 


Example 5. Consider the planar system 


£ = pr — 2x? 


y=-y 
which satisfies the conditions (3). There is a transcritical bifurcation at the 
origin at the bifurcation value 1 = 0. There are critical points at the origin 


and at (u,0). The phase portraits for this system are shown in Figure 8. 
The bifurcation diagram for this example is the same as the one in Figure 4. 


p<O 


Figure 8. The phase portraits for the system in Example 5. 
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Example 6. The system 


y=-y 


satisfies the conditions (4) and there is a pitchfork bifurcation at xo = 0 
and po = 0. For p < 0 the only critical point is at the origin and for 
p. > O there are critical points at the origin and at (+,/p,0). For u = 0, the 
nonhyperbolic critical point at the origin is a node according to Theorem 1 
in Section 2.11 of Chapter 2. The phase portraits for this system are shown 
in Figure 9 and the bifurcation diagram for this example is the same as the 
one shown in Figure 6. 


ps0 pe>o 


Figure 9. The phase portraits for the systems in Example 6. 


Just as in the case of one-dimensional systems, we can have equilibrium 
points of multiplicity m for higher dimensional systems. An equilibrium 
point is of multiplicity m if any perturbation produces at most m nearby 
equilibrium points and if there is a perturbation which produces exactly m 
nearby equilibrium points. This is discussed in detail for planar systems in 
Chapter VIII of (A-II]. The origin in Examples 4 and 5 is a critical point 
of multiplicity two; it is of multiplicity three in Example 6; and it is of 
multiplicity four in Problem 7. 


PROBLEM SET 2 
1. Consider the one-dimensional system 


& = —x* + 5x? — 4p?. 
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Determine the critical points and the bifurcation value for this dif- 
ferential equation. Draw the phase portraits for various values of the 
parameter p and draw the bifurcation diagram. 


. Carry out the same analysis as in Problem 1 for the one-dimensional 


system 


t= 2? — cp’. 


. Define the function 


ja) = {8g for z #0 


0 for zs = 0 
Show that f € C!(R). Consider the one-dimensional system 
t= f(z)—-p 


with f defined above. 


(a) Show that for » = 0 there are an infinite number of critical 
points in any neighborhood of the origin, that the nonzero criti- 
cal points are hyperbolic and alternate in stability, and that the 
origin is a nonhyperbolic critical point. 


(b) Show that p = 0 is a bifurcation value. 


(c) Draw a bifurcation diagram and show that there are an infinite 
number of bifurcation values which accumulate at yp = 0. What 
type of bifurcations occur at the nonzero bifurcation values? 


. Verify that the conditions (3) are satisfied by the system in Exam- 


ple 5. What are the dimensions of the various stable, unstable and 
center manifolds that occur in this system? 


. Verify that the conditions (4) are satisfied by the system in Exam- 


ple 6. What are the dimensions of the various stable, unstable and 
center manifolds that occur in this system? 


. If f satisfies the conditions of Theorem 1, what are the dimensions of 


the stable and unstable manifolds at the two hyperbolic critical points 
that occur near Xo for 4 > po (or up < to)? What are the dimensions 
if the conditions (2) are changed to (3) or (4)? Cf. Problems 4 and 5. 


. Consider the two-dimensional system 


= —o4 + Sur? — 4p? 
y= —Y. 
Determine the critical points and the bifurcation diagram for this 


system. Draw the phase portraits for various values of 4 and draw 
the bifurcation diagram. Cf. Problem 1. 
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4.3 Higher Codimension Bifurcations at 
Nonhyperbolic Equilibrium Points 


Let us continue our discussion of bifurcations at nonhyperbolic critical 
points and consider systems 


x = f(x, 2), (1) 


which depend on one or more parameters yp € R™. The system (1) has a 
nonhyperbolic critical point x9 € R” for wp = po € R” iff f(xo, 4) = O 
and the n x n matrix A = Df(xo, fo) has at least one eigenvalue with 
zero real part. We continue our discussion of the simplest case when the 
matrix A has exactly one zero eigenvalue and relegate a discussion of the 
cases when A has a pair of pure imaginary eigenvalues or a pair of zero 
eigenvalues to the next section and to Section 4.13, respectively. The case 
when A has exactly one zero eigenvalue (and no other eigenvalues with zero 
real parts) is the simplest case to study since the behavior of the system 
(1) for ys near the bifurcation value psp is completely determined by the 
behavior of the associated one-dimensional system 


& = F(z, 4) (2) 


on the center manifold for yz near pro. Cf. Examples 1-6 in the previous 
section. On the other hand, a more in-depth study of this case will allow us 
to illustrate some ideas and terminology that are basic to an understanding 
of bifurcation theory. In particular, we shall use examples of single zero 
eigenvalue bifurcations to gain an understanding of the concepts of the 
codimension and the universal unfolding of a bifurcation. 

If a structurally unstable vector field fo(x) is embedded in an m-parameter 
family of vector fields (1) with f(x, 9) = fo(x), then the m-parameter fam- 
ily of vector fields is called an unfolding of the vector field fo(x) and (1) is 
called a universal unfolding of fo(x) at a nonhyperbolic critical point xo if it 
is an unfolding of fo(x) and if every other unfolding of fo(x) is topologically 
equivalent to a family of vector fields induced from (1), in a neighborhood 
of xo. The minimum number of parameters necessary for (1) to be a uni- 
versal unfolding of the vector field fo(x) at a nonhyperbolic critical point 
Xo is called the codimension of the bifurcation at xo. Cf. p. 123 in [G/H] 
and pp. 284-286 in [Wi-II], where we see that if M is a manifold in some 
infinite-dimensional vector space or Banach space B, then the codimension 
of M is the smallest dimension of a submanifold N c B that intersects 
M transversally. Thus, if S is the set of all structurally stable vector fields 
in B = C'(E) and fy € S*° (the complement of S), then fo belongs to the 
bifurcation set in C!(£) that is locally isomorphic to a manifold M in B 
and the codimension of the bifurcation that occurs at fp is equal to the 
codimension of the manifold M. We illustrate these ideas by returning to 
the saddle-node and pitch-fork bifurcations studied in the previous section. 
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There is no loss of generality in assuming that xo = 0 and that yy = 0, and 
this assumption will be made throughout the remainder of this section. 

For the saddle-node bifurcation, the one-dimensional system (2) has the 
normal form F(z,0) = Fo(z) = az?, and the constant a can be made equal 
to —1 by rescaling the time; i.e., we shall consider unfoldings of the normal 
form 


z= —z?, (3) 
First of all, note that adding higher degree r-terms to (3) does not affect the 
behavior of the critical point at the origin; e.g., the system z = —z? + gz? 


has critical points at sz = 0 and at z = 1/3; x = 0 is a nonhyperbolic 
critical point, and the hyperbolic critical point z = 1/43 — 00 as p3 — 0. 
Thus it suffices to consider unfoldings of (3) of the form 


f= py + por — 2’. 


Cf. [Wi-II], pp. 263 and 280. Furthermore, by translating the origin of this 
system to the point z = 2/2, we obtain the system 

f=p—z? (4) 
with « = py, + 3/4. Thus, all possible types of qualitative dynamical 
behavior that can occur in an unfolding of (3) are captured in (4), and 
the one-parameter family of vector fields (4) is a universal unfolding of the 
vector field (3) at the nonhyperbolic critical point at the origin. Cf. [Wi-I]], 
pp. 280 and 300. Thus, all possible types of dynamical behavior for systems 
near (3) are exhibited in Figure 1 of the previous section, and the saddle- 
node bifurcation described in Figure 1 of Section 4.1 is a codimension-one 
bifurcation. 

For the pitch-fork bifurcation, the one-dimensional system (2) has the 
normal form (after rescaling time) F(z,0) = Fo(x) = —z°, and we consider 
unfoldings of 

t= —z’. (5) 
As we shall see, the one-parameter family of vector fields considered in 
Example 3 of the previous section is not a universal unfolding of the vector 
field (5) at the nonhyperbolic critical point at the origin. As in the case 
of the saddle-node bifurcation, we need not consider higher degree terms 
(of degree greater than three) in (5), and, by translating the origin, we 
can eliminate any second-degree terms. Therefore, a likely candidate for 
a universal unfolding of the vector field (5) at the nonhyperbolic critical 
point at the origin is the two-parameter family of vector fields 


t= py + pot — 2°. (6) 


And this is indeed the case; cf. [Wi-II], p. 301 or [G/H], p. 356; i.e., the 
pitch-fork bifurcation is a codimension-two bifurcation. In order to investi- 
gate the various types of dynamical behavior that occur in the system (6), 
we note that for 2 > 0 the cubic equation 


a* — por — py, = 0 
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has three roots iff u? < 443/27, two roots (at x = +./po/3) iff u? = 43/27 
and one root if u? > 43/27; it also has one root for all we < 0 and py, € R. 
It then is easy to deduce the various types of dynamical behavior of (6) 
shown in Figure 1 below for pe > 0. 


see 
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Figure 1. The phase portraits for the differential equation (6) with po > 0. 


The first three phase portraits in Figure 1 include all of the possible 
types of qualitative behavior for the differential equation (6) as well as 
the qualitative behavior for ua < 0 and yp, € R, which is described by 
the first phase portrait in Figure 1. Notice that the second phase portrait 
in Figure 1 does not appear in the list of phase portraits in Figure 5 of 
the previous section for the unfolding of the normal form (5) given by the 
one-parameter family of differential equations in Example 3 of the previous 
section. Clearly, that unfolding of (5) is not a universal unfolding; i-e., 
the pitch-fork bifurcation is a codimension-two and not a codimension-one 
bifurcation. The bifurcation diagram for the vector field (6), i.e., the locus 
of points satisfying 4, + 2x — x? = 0, which determines the location of 
the critical points of (6) for various values of the parameter x € R?, is 
shown in Figure 2; cf. Figure 12.1, p. 169 in (G/S]. The bifurcation set or 
the set of bifurcation points in the ps-plane, i.e., the set of y-points where 
(6) is structurally unstable, is also shown in Figure 2; it is the projection 
of the bifurcation points in the bifurcation diagram onto the p-plane. The 
bifurcation set (in the ys-plane) consists of the two curves, 

45 
M==Vo7 
for 42 > 0, at which points (6) undergoes a saddle-node bifurcation, and 
the origin. The two curves of saddle-node bifurcation points intersect in a 
cusp at the origin in the ys-plane, and the differential equation (6) is said 
to have a cusp bifurcation at yx = 0. Notice that for parameter values yz in 
the shaded region in Figure 2, the system (6) has three hyperbolic critical 
points, and for point yz outside the closure of this region the system (6) has 
one hyperbolic critical point. 

We conclude this section by describing the bifurcation set for universal 

unfolding of the normal form 


z= —z', (7) 


which has a multiplicity-four critical point at the origin. As in the previous 
two examples, it seems that a likely candidate for the universal unfolding of 
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X 


Figure 2. The bifurcation diagram and bifurcation set (in the p-plane) for 
the differential equation (6). 


(7) at the nonhyperbolic critical point at the origin is the three-parameter 
family of vector fields 


f= py + por + pyr? — 24. (8) 


And this is indeed the case; cf. [G/S], pp. 206-208. The bifurcation diagram 
for (8) is difficult to draw as it lies in R*; however, the bifurcation set 
for (8) in the three-dimensional parameter space is shown in Figure 3; cf. 
Figure 4.3, p. 208 in [G/S]. The shape of the bifurcation surface shown in 
Figure 3 gives this codimension-three bifurcation its name, the swallow-tail 
bifurcation. 

The bifurcation set in R? consists of two saddle-node bifurcation surfaces, 
SN, and SNo, which intersect in two cusp bifurcation curves, C; and C%, 
which intersect in a cusp at the origin. [The intersection of the surface 
SN, with itself describes the locus of ys-points where (8) has two distinct 
nonhyperbolic critical points at which saddle-node bifurcations occur.] For 
parameter values in the shaded region in Figure 3 between the saddle-node 
bifurcation surfaces, the differential equation (6) has four hyperbolic critical 
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Figure 3. The bifurcation set (in three-dimensional parameter space) for 
the differential equation (8). 


points: On SN2 and on the part of SN, adjacent to the shaded region 
in Figure 3, it has two hyperbolic critical points and one nonhyperbolic 
critical point; on the remaining part of SN, and at the origin, it has one 
nonhyperbolic critical point; on the C; and C> curves, it has one hyperbolic 
and one nonhyperbolic critical point; for points above the surface shown 
in Figure 3, (8) has two hyperbolic critical points, and for points below 
this surface (8) has no critical points. The various phase portraits for the 
differential equation (8) are determined in Problem 1. 

The examples discussed in this section were meant to illustrate the con- 
cepts of the codimension and universal unfolding of a structurally unstable 
vector field at a nonhyperbolic critical point. They also serve to illustrate 
the fact that for a single zero eigenvalue, a multiplicity m critical point 
results in a codimension-(m — 1) bifurcation. We close this section with 
an example that illustrates once again the power of the center manifold 
theory, not only in determining the qualitative behavior of a system at a 
nonhyperbolic critical point, but also in determining the possible types of 
qualitative dynamical behavior for nearby systems. 


Example 1 (The Cusp Bifurcation for Planar Vector Fields). In 
light of the comments made earlier in this section, it is not surprising that 
the universal unfolding of the normal form 
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is given by the two-parameter family of vector fields 


=p, +per— 2° 


y=-y. (9) 


ORK TH 


Figure 4. The phase portraits for the system (9) with po > 0. 


This system has a codimension-two, cusp bifurcation at 4 = 0 € R?. The 
bifurcation diagram and the bifurcation set (in the ys-plane) are shown 
in Figure 2. The possible types of phase portraits for this system are 
shown in Figure 4, where we see that there is a saddle-node at the points 
x = (+/p2/3,0) for points on the saddle-node bifurcation curves yp, = 
+ \/4u3/27 for 2 > 0; there is a saddle at the origin for yz in the shaded 
region in Figure 2, and the system (9) has exactly one critical point, a 
stable node, at any p-point outside the closure of that region and also at 
pt = 0 (in which case the origin of this system is a nonhyperbolic critical 
point). Notice that the middle phase portrait in Figure 4 does not appear 
in Figure 9 of the previous section. 


PROBLEM SET 3 


1. (a) Draw the phase portraits for the differential equation (8) with 
the parameter pz = (1), 2, 43) in the different regions of param- 
eter space described in Figure 3. 


(b) Draw the phase portraits for the system 


t= py + per + 3x? — r* 


y=-y 


with the parameter pe = (41, 2, 43) in the different regions of 
parameter space described in Figure 3. 


2. Determine a universal] unfolding for the following system, and draw 
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the various types of phase portraits possible for systems near this 
system: 
t= ry 
y=-y-2? 


Hint: Determine the flow on the center manifold as in Problem 3 in 
Section 2.12. 
3. Same thing as in Problem 2 for the system 
£=2*—szy 
y= yt’. 
Hint: See Problem 4 in Section 2.12. 
4. Same thing as in Problem 2 for the system 


z= xy 


y=-y—2’. 


5. Same thing as in Problem 2 for the system 


¢=-—x' 


yaa: 
6. Show that the universal unfolding of 
& = az’ + bry + cy’ 
y= -yt+dzr? +eryt fy’ 
(a) has a codimension-one saddle-node bifurcation at xp = Oifa #0, 


(b) has a codimension-two cusp bifurcation at yz = 0 if a = 0 and 
bd # 0, 


(c) has a codimension-three :.wallow-tail bifurcation at yp = 0 if 
a=b=0andcd #0. 


Hint: See Problem 6 in Section 2.12. 


4.4 Hopf Bifurcations and Bifurcations of Limit 
Cycles from a Multiple Focus 


In the previous sections, we considered various types of bifurcations that 
can occur at a nonhyperbolic equilibrium point x9 of a system 


x = f(x, 2) (1) 
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depending on a parameter pz € R when the matrix Df(xo, zo) had a simple 
zero eigenvalue. In particular, we saw that the saddle-node bifurcation was 
generic. In this section we consider various types of bifurcations that can 
occur when the matrix Df(xo, zo) has a simple pair of pure imaginary 
eigenvalues and no other eigenvalues with zero real part. In this case, the 
implicit function theorem guarantees that for each p near po there will 
be a unique equilibrium point x, near xo; however, if the eigenvalues of 
Df(x,, 4) cross the imaginary axis at ~ = po, then the dimensions of 
the stable and unstable manifolds of x, will change and the local phase 
portrait of (1) will change as py passes through the bifurcation value po. 
In the generic case, a Hopf bifurcation occurs where a periodic orbit is 
created as the stability of the equilibrium point x, changes. We illustrate 
this idea with a simple example and then present a general theory for planar 
systems. The reader should refer to [G/H], p. 150 or [Rul], p. 82 for the more 
general theory of Hopf bifurcations in higher dimensional systems which is 
summarized in Theorem 2 below. We also discuss other types of bifurcations 
for planar systems in this section where several limit cycles bifurcate from a 
critical point x» when Df(xo, zo) has a pair of pure imaginary eigenvalues. 


Example 1 (A Hopf Bifurcation). Consider the planar system 
= —-y+a2(u—2?—y’) 
y=arty(u—z’—y’). 


The only critical point is at the origin and 


i | 

Deon) = [4 |. 
By Theorem 4 in Section 2.10 of Chapter 2, the origin is a stable or an 
unstable focus of this nonlinear system if up < 0 or if ~ > 0 respectively. For 
p. = 0, Df(0,0) has a pair of pure imaginary eigenvalues and by Theorem 5 
in Section 2.10 of Chapter 2 and Dulac’s Theorem, the origin is either 
a center or a focus for this nonlinear system with pw = 0. Actually, the 
structure of the phase portrait becomes apparent if we write this system 
in polar coordinates; cf. Example 2 in Section 2.2 of Chapter 2: 


t=r(u-r’) 


d=1. 


We see that at p = 0 the origin is a stable focus and for pz > 0 there is a 
stable limit cycle 


Pu: Yy(t) = Jz(cost, sin t)7. 


The curves [,, represent a one-parameter family of limit cycles of this 
system. The phase portraits for this system are shown in Figure 1 and the 
bifurcation diagram is shown in Figure 2. The upper curve in the bifurcation 


4.4, Hopf Bifurcations and Bifurcations of Limit Cycles 351 


ps0 pL>O 


Figure 1. The phase portraits for the system in Example 1. 


Figure 2. The bifurcation diagram and the one-parameter family of limit 
cycles I’, resulting from the Hopf bifurcation in Example 1. 


diagram shown in Figure 2 represents the one-parameter family of limit 

cycles [',, which defines a surface in R? x R; cf. Figure 2. The bifurcation 

of the limit cycle from the origin that occurs at the bifurcation value » = 0 

as the origin changes its stability is referred to as a Hopf bifurcation. 
Next, consider the planar analytic system 


z= pr—-y+p(z,y) 
y=xrt+pyt+q(z,y) (2) 


where the analytic functions 


p(z,y) = >> arty? = (agoz? + airy + ao2y”) 
i+j>2 


+ (agox? + Qo\27y + ayory” + ao3y”) oes 
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and 


q(z,y) = > bz'y = (boox? + by zy + booy”) 

i+j>2 

+ (bgox° + bo 27y + biory? + bosy®) + °°. 
In this case, for p = 0, Df(0,0) has a pair of pure imaginary eigenvalues 
and the origin is called a weak focus or a multiple focus. The multiplicity m 
of a multiple focus was defined in Section 3.4 of Chapter 3 in terms of the 
Poincaré map P(s) for the focus. In particular, by Theorem 3 in Section 3.4 
of Chapter 3, we have 

P'(0) = e?"# 

for the system (2) and for = 0 we have P’(0) = 1 or equivalently d’(0) = 0 
where d(s) = P(s) — s is the displacement function. For p = 0 in (2), the 
Liapunov number ¢ is given by equation (3) in Section 3.4 of Chapter 3 as 


3 
c= = [3(a30 + bo3) + (@12 + 621) — 2(a20620 — ao2b02) 


+ @11(@o2 + @20) — b11(bo2 + b20)}. (3) 
In particular, if o 4 0 then the origin is a weak focus of multiplicity one, it 
is stable if o < 0 and unstable if o > 0, and a Hopf bifurcation occurs at 


the origin at the bifurcation value » = 0. The following theorem is proved 
in (A-II] on pp. 261-264. 


Theorem 1 (The Hopf Bifurcation). /fo #0, then a Hopf bifurcation 
occurs at the origin of the planar analytic system (2) at the bifurcation value 
pp = 0; in particular, if o < 0, then a unique stable limit cycle bifurcates 
from the origin of (2) as p increases from zero and if o > 0, then a unique 
unstable limit cycle bifurcates from the origin of (2) as yu decreases from 
zero. If o < 0, the local phase portraits for (2) are topologically equivalent 
to those shown in Figure 1 and there is a surface of periodic orbits which 
has a quadratic tangency with the (x, y)-plane at the origin in R? x R; cf. 
Figure 2. 


In the first case (o < 0) in Theorem 1 where the critical point generates 
a stable limit cycle as yz passes through the bifurcation value u = 0, we 
have what is called a supercritical Hopf bifurcation and in the second case 
(o > 0) in Theorem 1 where the critical point generates an unstable limit 
cycle as yz passes through the bifurcation value 4 = 0, we have what is 
called a subcritical Hopf bifurcation. 


Remark 1. For a general planar analytic system 
£ = art by + p(z,y) (2") 
y = cx + dy + q(z,y) 

with A = ad — bc > 0, a+d = 0 and p(z,y), q(z, y) given by the above 

series, the matrix 


D£(0) = h ‘ 


Cc 
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will have a pair of imaginary eigenvalues and the origin will be a weak 
focus; the Liapunov number ¢ is then given by the formula 


3 
c= spas (laclats + aiibo2 + ao2b11) + ab(b7, + @20b11 + 11602) 


+ c?(a11@92 + 2ao2bo2) — 2ac(b22 — a20@02) — 2ab(a%q — baobo2) 
— b?(2a29b20 + b11b20) + (be — 2a?)(bi1bp2 — 211.420) 
— (a? + bc)[3(cbo3 — bago) + 2a(a21 + bi2) + (cai2 — bbai)]}.  (3’) 


Cf. [A-II], p. 253. For o # 0 in equation (3’), Theorem 1 with np =a+d 
also holds for the system (2’). 
The addition of any higher degree terms to the linear system 


L=pr—-y 
y=r+py 


will result in a Hopf bifurcation at the origin at the bifurcation value » = 0 
provided the Liapunov number o # 0. The hypothesis that f is analytic in 
Theorem 1 can be weakened to f € C3(E x J) where E is an open subset 
of R? containing the origin and J C R is an interval. For f € C'(E x J), 
a one-parameter family of limit cycles is still generated at the origin at 
the bifurcation value » = 0, but the surface of periodic orbits will not 
necessarily be tangent to the (z, y)-plane at the origin; cf. Problem 2. 


The following theorem, proved by E. Hopf in 1942, establishes the exis- 
tence of the Hopf bifurcation for higher dimensional systems when Df (xo, 
to) has a pair of pure imaginary eigenvalues, Ag and Ao, and no other 
eigenvalues with zero real part; cf. (G/H], p. 151. 


Theorem 2 (Hopf). Suppose that the C4-system (1) with x € R” and 
ut € R has a critical point xo for up = po and that Df(xo, uo) has a sim- 
ple patr of pure imaginary eigenvalues and no other eigenvalues with zero 
real part. Then there is a smooth curve of equilibrium points x(u) with 
x(u0) = Xo and the eigenvalues, (4) and A(4) of Df(x(), 4), which are 
pure imaginary at 4 = po, vary smoothly with p. Furthermore, if 


FRA Humne # 0 


then there is a unique two-dimensional center manifold passing through the 
point (Xo, po) and a smooth transformation of coordinates such that the 
system (1) on the center manifold is transformed into the normal form 


t= —y + ax(z? + y?) — by(x? + y?) + O(|x|*) 
y= x + ba(x? + y*) + ay(z? + y?) + O(|x|*) 


in a neighborhood of the origin which, for a # 0, has a weak focus of 
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multiplicity one at the origin and 
& = px —y t+ az(z? + y*) — by(x? + y”) 
y=xt py + br(x? + y”) + ay(z? + y”) 


is a universal unfolding of this normal form in a neighborhood of the origin 
on the center manifold. 


In the higher dimensional case, if a # 0 there is a two-dimensional surface 
S of stable periodic orbits for a < 0 [or unstable periodic orbits for a > 0; 
cf. Problem 1(b)] which has a quadratic tangency with the eigenspace of 
Xo and Xo at the point (xo, uo) € R” x R; i.e., the surface S is tangent to 
the center manifold W°(x9) of (1) at the nonhyperbolic equilibrium point 
Xo for p = po. Cf. Figure 3. 


Figure 3. A one-parameter family of periodic orbits S resulting from a 
Hopf bifurcation at a nonhyperbolic equilibrium point xo and a bifurcation 
value pio. 


We next illustrate the use of formula (3) for the Liapunov number ga in 
determining whether a Hopf bifurcation is supercritical or subcritical. 


Example 2. The quadratic system 
£=pr—ytsx? 
y=rotpyt2 


has a weak focus of multiplicity one at the origin for 4 = 0 since by equa- 
tion (3) the Liapunov number o = —3z ¥ 0. Furthermore, since a < 0, it 
follows from Theorem 1 that a unique stable limit cycle bifurcates from the 
origin as the parameter p increases through the bifurcation value p = 0; 
i.e. the Hopf bifurcation is supercritical. The limit cycle for this system at 
the parameter value yz = .1 is shown in Figure 4. The bifurcation diagram 
is the same as the one shown in Figure 2. 
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Figure 4. The limit cycle for the system in Example 2 with pu = .1. 


If 4 = o = 0 in equation (2) where o is given by equation (3), then the 
origin will be a weak focus of multiplicity m > 1 of the planar analytic 
system (2). The next theorem, proved in Chapter IX of [A-II] shows that 
at most m limit cycles can bifurcate from the origin as p varies through 
the bifurcation value » = 0 and that there is an analytic perturbation of 
the vector field in 

t= —y+p(z,y) (4) 
y = 2+9(z,y) 
which causes exactly m limit cycles to bifurcate from the origin at 4 = 0. In 
order to state this theorem, we need to extend the notion of the C!-norm 
defined on the class of functions C!(E) to the C*-norm defined on the class 
C*(E); i.e., for f € C*(E) where E is an open subset of R”, we define 


lfllk = sup |£(%)| + sup || D£(x)|| + --- + sup ||D*£(x)Il 


where for the norms || - || on the right-hand side of this equation we use 


O* f(x) 


k = 
|D*E(x) = max | 5 


? 


the maximum being taken over j),..., 7, =1,...,n. Each of the spaces of 
functions in C*(E), bounded in the C*-norm, is then a Banach space and 
C*+1(E) c C*(E) for k =0,1,2,.... 
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Theorem 3 (The Bifurcation of Limit Cycles from a Multiple 
Focus). If the origin is a multiple focus of multiplicity m of the analytic 
system (4) then fork > 2m+1 


(i) there is a6 > 0 and ane > 0 such that any system €-close to (4) in 
the C*-norm has at most m limit cycles in Ns5(0) and 


(ii) for any 6 > 0 andeée > 0 there is an analytic system which is €-close 
to (4) in the C*-norm and has exactly m simple limit cycles in Ns(0). 


In Theorem 5 in Section 3.8 of Chapter 3, we saw that the Lienard system 


t= y — [az + agr? +--+ + Gem4.2°™"*"] 


j=-2 


has at most m local limit cycles and that there are coefficients with a), a3, 
..+)@2m4) alternating in sign such that this system has m local limit cycles. 
This type of system with a, = --- = @am = 0 and aam4) 4 0 has a weak 
focus of multiplicity m at the origin. We consider one such system with 
m = 2 in the next example. 


Example 3. Consider the system 


= y —e[uz t+ a3zr* + asz’] 
y=-2 


with a3 < 0,as5 > 0 and small ec # 0. By (3’), if ~ = 0 and a3 = 0 then 
o = 0. Therefore, the origin is a weak focus of multiplicity m > 2. And by 
Theorem 5 in Section 3.8 of Chapter 3, it is a weak focus of multiplicity m < 
2. Thus, the origin is a weak focus of multiplicity m = 2. By Theorem 2, 
at most two limit cycles bifurcate from the origin as yz varies through the 
bifurcation value yp = 0. To find coefficients a3 and as for which exactly 
two limit cycles bifurcate from the origin at 4 = 0, we use Theorem 6 in 
Section 3.8 of Chapter 3; cf. Example 4 in that section. We find that for 
p > 0 and for sufficiently small ¢ 4 0 the system 


L=y-€E uc — 4p'/273 + 57] 
j=-2 


has exactly two limit cycles around the origin that are asymptotic to circles 
of radius r = #/ and r = {/y/4 as € — 0. For € = .01, the limit cycles of 
this system are shown in Figure 5 for w = .5 and p = 1. The bifurcation 
diagram for this last system with small e 4 0 is shown in Figure 6. 

A rich source of examples for planar systems having limit cycles are 
systems of the form 


z 
y 


—y + ryp(r, H) 


x + yp(r, 2) (5) 
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where r = \/z? + y?. Many of Poincaré’s examples in [P] are of this form. 
The bifurcation diagram, of curves representing one-parameter families of 
limit cycles, is given by the graph of the relation w(r, 1) = 0 in the upper 
half of the (z,7r)-plane where r > 0. The system in Example 1 is of this 
form and we consider one other example of this type having a weak focus 
of multiplicity two at the origin. 


OO 


Figure 5. The limit cycles for the system in Example 3 with p = .5 and 
p=l. 


Figure 6. The bifurcation diagram for the limit cycles which bifurcate from 
the weak focus of multiplicity two of the system in Example 3 (with e < 0, 
the stabilities being reversed for ¢ > 0). 
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Example 4. Consider the planar analytic system 
é = -y+2(u—1)(u— 2r?) 
y=r+y(u—r?)(u—2r?) 


where r? = x? + y. According to the above comment, the bifurcation dia- 
gram is given by the curves r = ,/u and r = ,//2 in the upper half of the 
(4, 17)-plane; cf. Figure 7. In fact, writing this system in polar coordinates 
shows explicitly that for 4 > 0 there are two limit cycles represented by 
2,(t) = /u(cost,sint)? and yo(t) = \/u/2(cost, sint)?. The inner limit 
cycle y(t) is stable and the outer limit cycle +, (t) is unstable. The multi- 
plicity of the weak focus at the origin of this system is two. 


Figure 7. The bifurcation diagram for the system in Example 4. 


As in the last two examples (and as in Theorem 5 in Section 3.8), we 
can obtain polynomial systems with a weak focus of arbitrarily large mul- 
tiplicity; however, it is a much more delicate question to determine the 
maximum number of local limit cycles that are possible for a polynomial 
system of fixed degree. The answer to this question is currently known only 
for quadratic systems. Bautin [2] showed that a quadratic system can have 
at most three local limit cycles and that there exists a quadratic system 
with a weak focus of multiplicity three. The next theorem, established in 
[62], gives us a complete set of results for determining the Liapunov num- 
ber, W, = d‘2*+1)(0), or the multiplicity of the weak focus at the origin for 
the quadratic system (6) below. We note that it follows from equation (3) 
that o = 37nW,/2 for the quadratic system (6); cf. Problem 7. 


Theorem 4 (Li). Consider the quadratic system 


z= —y+azr’?+bry (6) 
y= acter? +mazy+ ny’ 
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and define 


W, = a(b — 2@) — m(é+n) 
W2 = a(2a + m)(3a — m)[a?(b — 2@ — n) + (€+ n)?(n — b)} 
W3 = a7(2a + m)(2@ + n)[a?(b — 2€ — n) + (€+n)?(n — b)}. 


Then the origin is 

(i) a weak focus of multiplicity 1 iff W, # 0, 

(ii) a@ weak focus of multiplicity 2 iff W, =0 and W2 £0, 
(iii) a weak focus of multiplicity 3 iff W, = W2 = 0 and W3 £0, and 
(iv) a center iff W, = W2 = W3 = 0. 


Furthermore, if for k = 1,2 or 3 the origin is a weak focus of multiplicity 
k and the Liapunov number W,, < 0 (or Wy > 0), then the origin of (6) is 
stable (or unstable). 


Remark 2. It follows from Theorem 2 that the one-parameter family of 
vector fields in Example 1 is a universal unfolding of the normal form 


f= -y—2(r? +?) 
y=xr—y(z? +y?) 


(cf. the normal form in Problem 1(b) with a = —1 and b = 0) whose linear 
part has a pair of pure imaginary eigenvalues +7 and which has o = —97 
according to (3). Thus, the Hopf bifurcation described in Example 1 or 
in Theorem 2 is a codimension-one bifurcation. More generally, a bifurca- 
tion at a weak focus of multiplicity m is a codimension-m bifurcation. See 
Remark 4 at the end of Section 4.15. 


Remark 3. The system in Example 1 defines a one-parameter family of 
(negatively) rotated vector fields with parameter p € R (according to Def- 
inition 1 in Section 4.6). And according to Theorem 5 in Section 4.6, any 
one-parameter family of rotated vector fields can be used to obtain a uni- 
versal unfolding of the normal form for a C! or polynomial system with a 
weak focus of multiplicity one. 


PROBLEM SET 4 
1. (a) Show that for a + b 4 0 the system 
z= px —yta(x? + y?)z — d(x? + y?)y + 0(|xI*) 
y=xrtpyt a(x? + y?)z + b(x? + y*)y + 0(|x|*) 


has a Hopf bifurcation at the origin at the bifurcation value 
p. = 0. Determine whether it is supercritical or subcritical. 
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(b) Show that for a # 0 the system in the last paragraph in Sec- 
tion 2.13 (or in Theorem 2 above), 


L=pxr—yt a(x? + y*)x — b(x? + y*)y + 0(|x|*) 
y=x+ py + d(x? + y*)x + a(x? + y*)y + 0(|x/*), 


has a Hopf bifurcation at the origin at the bifurcation value 
pe = 0. Determine whether it is supercritical or subcritical. Note 
that for 0 < r < 1 either one of the above systems defines a 
one-parameter family of (negatively) rotated vector fields with 
parameter yp (according to Definition 1 in Section 4.6). Cf. Prob- 
lem 2(b) in Section 4.6. 


2. Consider the C!-system 


E=pxr—y-—a@ry27? + y? 
y=rutpy—yVr? +y?. 


(a) Show that the vector field f defined by this system belongs to 
C!(R? x R); i.e., show that all of the first partial derivatives 
with respect to z, y and p are continuous for all z, y and yp. 


(b) Write this system in polar coordinates and show that for p > 0 
there is a unique stable limit cycle around the origin and that 
for p < O there is no limit cycle around the origin. Sketch the 
phase portraits for these two cases. 


(c) Draw the bifurcation diagram and sketch the conical surface 
generated by the one-parameter family of limit cycles of this 
system. 


3. Write the differential equation 


#+ pr + (zr —2x°) =0 


as a planar system and use equation (3’) to show that at the bifur- 
cation value 4 = 0 the quantity o = 0. Draw the phase portrait for 
the Hamiltonian system obtained by setting p = 0. 


. Write the system 


t= —-y+2("—17)(u— 2r*) 
y=rty(p—r*)(u— 2r’) 


in polar coordinates and show that for yz > 0 there are two limit cycles 


represented by +, (t) = /u(cost, sin t)? and y(t) = /p/2(cost, 
sint)?. Draw the phase portraits for this system for  < 0 and p > 0. 
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5. Draw the bifurcation diagram in the (y,7r)-plane for the system 
z= —y+2(r? — p)(2r? — p)(3r? — p) 
y=aty(r? — p)(2r? — p)(3r? — p). 
What can you say about the multiplicity m of the weak focus at the 
origin of this system? 


6. Use Theorem 6 in Section 3.8 of Chapter 3 to find coefficients a3(,2), 
as(jz) and a7 for which three limit cycles, asymptotic to circles of 
radii 7, = p)/6/2, ro = p'/6 and rz = V2pu'/6 as € — 0, bifurcate 
from the origin of the Lienard system 

= y —elpr + a3z° + asx? + a72'] 
y=-2 
at the bifurcation value p = 0. 


7. Use equation (3) to show that o = 3xW,/2 for the system (6) in 
Theorem 4 with W, given by the formula in that theorem. 
8. Consider the quadratic system 
f= pr-—yta?t+ay 
y=rotpytzr? +mzy t+ ny’. 

(a) For = 0, derive a set of necessary and sufficient conditions 
for this system to have a weak focus of multiplicity one at the 
origin. If m = 0 or if n = —1, is the Hopf bifurcation at the 
origin supercritical or subcritical? 

(b) For » = 0, derive a set of necessary and sufficient conditions for 
this system to have a weak focus of multiplicity two at the origin. 
In this case, what happens as p varies through the bifurcation 
value 9 = 0? Hint: See Theorem 5 in Section 4.6. Also, see 
Problem 4(a) in Section 4.15. 

(c) For » = 0, show that there is exactly one point in the (m,n) 
plane for which this system has a weak focus of multiplicity three 
at the origin. In this case, what happens as p varies through the 
bifurcation value zo = 0? (See the hint in part b.) 

(d) For » = 0, show that there are exactly three points in the (m,n) 


plane for which this system has a center. At which one of these 
points do we have a Hamiltonian system? 


9. Use equation (3’) to show that o = kF[cF? + (cF + 1)(F - E+ 


2c)|, with the positive constant k = 37/ |2|EF |\JJl+ EF Bi, for the 


uadratic system 
: t=-r+Eyt+y? 


y= Frt+y-—azyt+cy’ 
with 1+ EF < 0. (This result will be useful in doing some of the 
problems in Section 4.14). 
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4.5 Bifurcations at Nonhyperbolic Periodic Orbits 


Several interesting types of bifurcations can take place at a nonhyperbolic 
periodic orbit; i.e., at a periodic orbit having two or more characteristic ex- 
ponents with zero real part. As in Theorem 2 in Section 3.5 of Chapter 3, 
one of the characteristic exponents is always zero. In the simplest case of a 
nonhyperbolic periodic orbit when there is one other zero characteristic ex- 
ponent, the periodic orbit [ has a two-dimensional center manifold W‘°(T) 
and the simplest types of bifurcations that occur on this manifold are the 
saddle-node, transcritical and pitchfork bifurcations, the saddle-node bifur- 
cation being generic. This is the case when the derivative of the Poincaré 
map, DP(xo), at a point xo € I’, has one eigenvalue equal to one. If DP(xo) 
has one eigenvalue equal to —1, then generically a period-doubling bifur- 
cation occurs which corresponds to a flip bifurcation for the Poincaré map. 
And if DP(xo) has a pair of complex conjugate eigenvalues on the unit cir- 
cle, then generically [' bifurcates into an invariant two-dimensional torus; 
this corresponds to a Hopf bifurcation for the Poincaré map. Cf. Chapter 2 
in [Ru]. 
We shall consider C!-systems 


x = f(x, p) (1) 
depending on a parameter yp € R where f € C'(E x J), E is an open subset 
in R” and J C R is an interval. Let @,(x, 4) be the flow of the system (1) 
and assume that for ~ = po, the system (1) has a periodic orbit [9 c E 
given by x = @,(Xo, Wo). Let & be the hyperplane perpendicular to [9 at 
point xg € Io. Then, using the implicit function theorem as in Theorem 1 
in Section 3.4 of Chapter 3, it can be shown that there is a C' function 
T(x, 2) defined in a neighborhood N¢(xo, 110) of the point (x9, uo) € BE x J 
such that 

Pr(x,p)(% H) Ed 

for all (x, 2) € Ns(xo, uo). As in Section 3.4 of Chapter 3, it can be shown 
that for each p € N¢(p0), P(x, p) is a C'-diffeomorphism on N5(xo). Also, 
if we assume that (1) has a one-parameter family of periodic orbits I, 
i.e., if P(x, 2) has a one-parameter family of fixed points x,, then as in 
Theorem 2 in Section 3.4 of Chapter 3, we have the following convenient 
formula for computing the derivative of the Poincaré map of a planar C’- 
system (1): 


Ty 
DP (ust) = exp |” V-£(ry(t)s1)dt (2) 
at a point x, € I, where the one-parameter family of periodic orbits 
Py: x=~7¥,(t), OS t<sT, 


and T,, is the period of +,,(t). Before beginning our study of bifurcations at 
nonhyperbolic periodic orbits, we illustrate the dependence of the Poincaré 
map P(x, 4) on the parameter p with an example. 
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Example 1. Consider the planar system 
¢=—-yt+2(u-r’) 
y=aty(u—r’) 


of Example 1 in Section 4.4. As we saw in the previous section, a one- 
parameter family of limit cycles 


Py: Y,(t) = Ju(cost, sin t)7, 


with p > 0, is generated in a supercritical Hopf bifurcation at the origin at 
the bifurcation value » = 0. The bifurcation diagram is shown in Figure 2 
in Section 4.4. In polar coordinates, we have 

# =r(u—r’) 


@=1. 


The first equation can be solved as a Bernoulli equation and for r(0) = ro 
we obtain the solution 


a A es Ge 
( ) ps a 


for 4» > 0. On any ray from the origin, the Poincaré map P(ro,p) = 
r(2z, To, LK); 1.e., 


1 1 1 ral? 


It is not difficult to compute the derivative of this function with respect to 
To and obtain 


1 1 1 a 
DP(ro, p) =e 44* rg 3 F * (= ~ | aaa 
Le To F 


Solving P(r, 4) = Tr, we obtain a one-parameter family of fixed points of 
P(r, 4), Th = Jp for p > 0 and this leads to 


DP(r,, ) = a 


This formula can also be obtained using equation (2); cf. Problem 1. Since 
for p > 0, DP(r,,) < 1, the periodic orbits [,, are all stable and hyper- 
bolic. 


The system (1) is said to have a nonhyperbolic periodic orbit Po through 
the point xo at a bifurcation value po if DP(xo, 49) has an eigenvalue of 
unit modulus. We begin our study of bifurcations at nonhyperbolic peri- 
odic orbits with some simple examples of the saddle-node, transcritical and 
pitchfork bifurcations that occur when DP(xo, uo) has an eigenvalue equal 
to one. 
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Example 2 (A Saddle-Node Bifurcation at a Nonhyperbolic Pe- 
riodic Orbit). Consider the planar system 


¢ = —y—2[y—(r? - 1) 
y=2—ylp—(r? -1)?] 


which is of the form of equation (5) in Section 4.4. Writing this system in 
polar coordinates yields 
f= rp - (r? - 1)7] 


d=1. 


For pz > 0 there are two one-parameter families of periodic orbits 


+. ~+/4) — aT 
Pe: vi (t) = V1+ p)/2(cost, sin t) 


with parameter p. Since the origin is unstable for 0 < yz < 1, the smaller 
limit cycle IY; is stable and the larger limit cycle Le is unstable. For p = 0 
there is a semistable limit cycle [9 represented by -yo(t) = (cost, sint)?. 
The phase portraits for this system are shown in Figure 1 and the bifurca- 
tion diagram is shown in Figure 2. Note that there is a supercritical Hopf 
bifurcation at the origin at the bifurcation value p = 1. 


In Example 2 the points i. = J/1+yp)/2 are fixed points of the Poincaré 
map P(r, 2) of the periodic orbit o(t) along any ray from the origin 


D = {xe R?|r>0,6 = 6}; 


ie., we have d(/1+ p!/2, 1) = O where d(r,u) = P(r,u) — 1 is the dis- 
placement function. The bifurcation diagram is given by the graph of the 
relation d(r, 4) = 0 in the (yz, r)-plane. Using equation (2), we can compute 
the derivative of the Poincaré map at r= = /1+ p}/2: 


DP(V1 + p)/2, p) = et8e (tnt?) 


cf. Problem 2. We see that for 0 < p < 1,DP(V/1—p!/2,p) < 1 and 
DP(V1+ p!/2, 4) > 1; the smaller limit cycle is stable and the larger 
limit cycle is unstable as illustrated in Figures 1 and 2. Furthermore, for 
p. = 0 we have DP(1,0) = 1, i.e., y(t) is a nonhyperbolic periodic orbit 
with both of its characteristic exponents equal to zero. 


Remark 1. In general, for planar systems, the bifurcation diagram is given 
by the graph of the relation d(s, ~) = 0 in the (, s)-plane where 


d(s,u) = P(s,4) —s 


is the displacement function along a straight line © normal to the nonhyper- 
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o@® 
O& 


O<p<l 2! 


Figure 1. The phase portraits for the system in Example 2. 


Figure 2. The bifurcation diagram for the saddle-node bifurcation at the 
nonhyperbolic periodic orbit yg(t) of the system in Example 2. 


bolic periodic orbit 9 at x9. We take s to be the signed distance along the 
straight line L, with s positive at points on the exterior of ‘9 and negative 
at points on the interior of I'9, as in Figure 3 in Section 3.4 of Chapter 3. 
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Figure 3. The one-parameter family of periodic orbits S of the system in 
Example 2. 


In this context, it follows that for each fixed value of yu, the values of s for 
which d(s, 4) = 0 define points x; on & near the point x9 € 9 ND through 
which the system (1) has periodic orbits -y;(t) = ,(x,;). For example, in 
Figure 2, each vertical line 4 = constant, with 0 < yu < 1, intersects the 
curve d(r, 4) = 0 in two points (p, /1 + p!/2); and the system in Example 2 
has periodic orbits -y*(t) through the points (/1 + 1/2, 0) on the z-axis in 
the phase plane. As in Figure 2 in Section 4.4, each one-parameter family of 
periodic orbits generates a surface S in R? x R. For example, the periodic 
orbits of the system in Example 2 generate the surface S shown in Figure 3. 
Since in general there is only one surface generated at a saddle-node bifur- 
cation at a nonhyperbolic periodic orbit, we regard the two one-parameter 
families of periodic orbits (with parameter yz) as belonging to one and the 
same family of periodic orbits. In this case, we can always define a new 
parameter ( (such as the arc length along a path on the surface S) so that 
I’,,(8) defines a one-parameter family of periodic orbits with parameter (. 


Example 3 (A Transcritical Bifurcation at a Nonhyperbolic Pe- 
riodic Orbit). Consider the planar system 


= —-y-—2(1—r’)(l+p-r?) 
y=r-—y(l—r?)\(l+py-r’). 
In polar coordinates we have 


r = —r(l—r?)(1+p-—r?) 


d=1. 


For all « € R, this system has a one-parameter family of periodic orbits 
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represented by 
“1o(t) = (cost, sin t)” 


and for » > —1, there is another one-parameter family of periodic orbits 


represented by 
Y,(t) = V1 + u(cost,sin t)* 


The bifurcation diagram, showing the transcritical bifurcation that occurs 
at the nonhyperbolic periodic orbit +9(t) at the bifurcation value yz = 0, is 
shown in Figure 4. Note that a subcritical Hopf bifurcation occurs at the 
nonhyperbolic critical point at the origin at the bifurcation value np = —1. 


Figure 4. The bifurcation diagram for the transcritica] bifurcation at the 
nonhyperbolic periodic orbit y(t) of the system in Example 3. 


In Example 3 the points r, = /1 + u and r, = 1 are fixed points of the 
Poincaré map P(r, uz) of the nonhyperbolic periodic orbit Ig; i.e., we have 


d(f1+p,pu) =0 


for all ~ > —1 and 
d(1, 4) =0 


for all « € R where d(r, nu) = P(r, uw) —r. Furthermore, using equation (2), 


we can compute 
DP(. /1 + p, p) = e7 4H(1+H)* 


and 


DP(1, 2) = e4#", 


cf. Problem 2. This determines the stability of the two families of periodic 
orbits as indicated in Figure 4. We see that DP(1,0) = 1; i.e., there is a 
nonhyperbolic periodic orbit 9 with both of its characteristic exponents 
equal to zero at the bifurcation value p = 0. In this example, there are two 
distinct surfaces of periodic orbits, a cylindrical surface and a parabolic 
surface, which intersect in the nonhyperbolic periodic orbit Io; cf. Prob- 
lem 3. 
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Example 4 (A Pitchfork Bifurcation at a Nonhyperbolic Periodic 
Orbit). Consider the planar system 
t= —y+2(1—1)[y —(r? - 1)7] 
y=xrt+y(1—1)[y— (r? -1)7). 
In polar coordinates we have 


t=r(1-r*)[y-(r? -1)?] 


0d=1. 


For all » € R, this system has a one-parameter family of periodic orbits 
represented by 
Yo(t) = (cost, sin t)? 

and for » > 0 there is another family (with two branches as in Remark 1) 
represented by 

or (t) = V1 + p)/2(cost, sint)?. 
Using equation (2) we can compute 

DP(V1E pi, p) = etme! 
and 


DP(1, ») = e~4™4. 


This determines the stability of the two families of periodic orbits as in- 
dicated in Figure 5(a). We also see that DP(1,0) = 1; ie, there is a 


(a) (b) 


Figure 5. The bifurcation diagram for the pitchfork bifurcation at the 
nonhyperbolic periodic orbit 9(t) of the system (a) in Example 4 and (b) 
in Example 4 with t — —t. 
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nonhyperbolic periodic orbit Io with both of its characteristic exponents 
equal to zero at the bifurcation value 1 = 0. Note that a Hopf bifurcation 
occurs at the nonhyperbolic critical point at the origin at the bifurcation 
value 4 = 1. Also, note that if we reverse the sign of ¢ in this example, 
i.e., let t +> —t, then we reverse the stability of the periodic orbits and we 
would have the bifurcation diagram with a pitchfork bifurcation shown in 
Figure 5(b). 

Using the implicit function theorem, conditions can be given on the 
derivatives of the Poincaré map which imply the existence of a saddle-node, 
transcritical or pitchfork bifurcation at a nonhyperbolic periodic orbit of 
(1). We shall only give these conditions for planar systems. In the next 
theorem P(s, 4) denotes the Poincaré map along a normal line & to a non- 
hyperbolic periodic orbit Io at a bifurcation value = po in (1). As in 
Section 4.2, D denotes the partial derivative of P(s, 2) with respect to the 
spatial variable s. 


Theorem 1. Suppose that f € C?(E x J) where E is an open subset of 
R2 and J C R is an interval. Assume that for 1 = po the system (1) has a 
periodic orbit 9 C E and that P(s, pu) is the Poincaré map for T'9 defined 
in a neighborhood N¢(0, uo). Then if P(0, 40) = 0, DP(0, uo) = 1, 


D?P(0,40) #0 and P,(0,u0) #0, (3) 


it follows that a saddle-node bifurcation occurs at the nonhyperbolic periodic 
orbit [9 at the bifurcation value p = po; i.e., depending on the signs of the 
expressions in (3), there are no periodic orbits of (1) near To when p < po 
(or when pp > po) and there are two periodic orbits of (1) near T'9 when 
Ht > Mo (or when p < po). The two periodic orbits of (1) near To are 
hyperbolic and of the opposite stability. 

If the conditions (3) are changed to 


P,(0,40) =0 DP,(0,40) #0 and (4) 
D? P(0, uo) # 0, 
then a transcritical bifurcation occurs at the nonhyperbolic periodic orbit To 
at the bifurcation value p = po. And if the conditions (3) are changed to 


P,,(0, po) = 0, DP,,(0, Ho) # 0 (5) 
D? P(0, 0) =0 and D*P(0, uo) £0, 
then a pitchfork bifurcation occurs at the nonhyperbolic periodic orbit To at 
the bifurcation value pp = po. 


Remark 2. Under the conditions (3) in Theorem 1, the periodic orbit To 
is a multiple limit cycle of multiplicity m = 2 and exactly two limit cycles 
bifurcate from the semi-stable limit cycle [9 as varies from po in one sense 
or the other. In particular, if D?P(0, wo) and P,,(0, 40) have opposite signs, 
then there are two limit cycles near Io for all sufficiently small p — po > 0 
and if D*P(0,40) and P,,(0,40) have the same sign, then there are two 
limit cycles near [9 for all sufficiently small po — p > 0. 
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Remark 3. It follows from equation (2) that 


To 


DP(0, po) = ai V-£(Yo(7).mo)dr 
where To is the period of the nonhyperbolic periodic orbit 
To: X = Yo(¢). 


Furthermore, in this case we also have a formula for the partial derivative 
of the Poincaré map P with respect to the parameter p in terms of the 
vector field f along the periodic orbit Tp: 


To pT 
ss J? 9-£0-¥0(7),H0)dr 
P,,(0, Ho) = lf (7 (0))| / e fA f..(Yo(t), Ho)at (6) 


where wo = +1 according to whether Ip is positively or negatively oriented, 
and the wedge product of two vectors u = (u),u2)? and v = (v, v2)" is 
given by the determinant 


U) 
Vv) 


uAv= = U) V2 — VU) U2. 


This formula was apparently first derived by Andronov et al.; cf. equa- 
tion (36) on p. 384 in [A-II]. It is closely related to the Melnikov function 
defined in Section 4.9. 

These same types of bifurcations also occur in higher dimensional systems 
when the derivative of the Poincaré map, DP(xo, po), for the periodic orbit 
Io has a single eigenvalue equal to one and no other eigenvalues of unit 
modulus; cf., e.g. Theorem II.2, p. 65 in [Ru]. Furthermore, in this case the 
saddle-node bifurcation is generic; cf. pp. 58 and 64 in (Rul. 

Before discussing some of the other types of bifurcations that can occur 
at nonhyperbolic periodic orbits of higher dimensional systems (1) with 
n > 3, we first discuss some of the other types of bifurcations that can 
occur at multiple limit cycles of planar systems. Recall that a limit cycle 
“Yo(t) is a multiple limit cycle of (1) if and only if 


To 
i V -f(o(t))dt = 0. 


Cf. Definition 2 in Section 3.4 of Chapter 3. Analogous to Theorem 2 in 
Section 4.4 for the bifurcation of m limit cycles from a weak focus of multi- 
plicity m, we have the following theorem, proved on pp. 278-282 in [A-I]], 
for the bifurcation of m limit cycles from a multiple limit cycle of multi- 
plicity m of a planar analytic system 


z= P(z,y) 


y= Q(z, y). ") 
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Theorem 2. [fT is a multiple limit cycle of multiplicity m of the planar 
analytic system (7), then 


(i) there is a5 >0 and ane >0 such that any system €-close to (7) in 
the C™-norm has at most m limit cycles in a 6-neighborhood, Ns(T), 
of [> and 


(ii) for any 5 > 0 ande > 0 there is an analytic system which ts €-close to 
(7) in the C™-norm and has exactly m simple limit cycles in Ng(T0). 


It can be shown that the nonhyperbolic limit cycles in Examples 2 and 
3 are of multiplicity m = 2 and that the nonhyperbolic limit cycle in 
Example 4 is of multiplicity m = 3. It can also be shown that the system 
(5) in Section 4.4 with 


O(r, w) = [w — (r? — 1)7)[u — 2(r? — 1?) 


has a multiple limit cycle y9(t) = (cost,sint)? of multiplicity m = 4 at 
the bifurcation value 4 = 0 and that exactly four hyperbolic limit cycles 
bifurcate from yo(t) as yu increases from zero; cf. Problem 4. Codimension- 
(m —1) bifurcations occur at multiplicity-m limit cycles of planar systems. 
These bifurcations were studied by the author in [39]. 

We next consider some examples of period-doubling bifurcations which 
occur when DP(Xo, #0) has a simple eigenvalue equal to —1 and no other 
eigenvalues of unit modulus. Figure 6 shows what occurs geometrically at a 
period-doubling bifurcation at a nonhyperbolic periodic orbit [9 (shown as 
a dashed curve in Figure 6). Since trajectories do not cross, it is geometri- 
cally impossible to have a period-doubling bifurcation for a planar system. 


Figure 6. A period-doubling bifurcation at a nonhyperbolic periodic 
orbit Ip. 
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This also follows from the fact that, by equation (2), DP(xo, uo) = 1 for 
any nonhyperbolic limit cycle To. 

Suppose that P(x, ) is the Poincaré map defined in a neighborhood 
of the point (xo, 40) € E x J where Xo is a point on the periodic orbit 
To of (1) with » = po, and suppose that DP(xo, 40) has an eigenvalue 
—1 and no other eigenvalues of unit modulus. Then generically a period- 
doubling bifurcation occurs at the nonhyperbolic periodic orbit [9 and it 
is characterized by the fact that for all ~ near yo, and on one side or the 
other of jo, there is a point x, € L, the hyperplane normal to [9 at xo, 
such that x,, is a fixed point of P? = PoP; ie., 


P?(x,, 1) = X,. 


Since the periodic orbits with periods approximately equal to 27 corre- 
spond to fixed points of the second iterate P? of the Poincaré map, the 
bifurcation diagram, which can be obtained by using a center manifold re- 
duction as on pp. 157-159 in [G/H], has the form shown in Figure 7. The 
curves in Figure 7 represent the locus of fixed points of P? in the (y, 2) 
plane where zx is the distance along the curve where the center manifold 
W<(I9) intersects the hyperplane ©. In Figure 7(a) the solid curve for > 0 
corresponds to a single periodic orbit whose period is approximately equal 
to 27> for small 4 > 0. Since there is only one periodic orbit whose period 
is approximately equal to 27> for small yz > 0, the bifurcation diagram for 
a period-doubling bifurcation is often shown as in Figure 7(b). 


(a) (b) 
Figure 7. The bifurcation diagram for a period-doubling bifurcation. 


We next look at some period-doubling bifurcations that occur in the 
Lorenz system introduced in Example 4 in Section 3.2 of Chapter 3. The 
Lorenz system was first studied by the meteorologist-mathematician E. N. 
Lorenz in 1963. Lorenz derived a relatively simple system of three non- 
linear differential equations which captures many of the salient features of 
convective fluid motion. The Lorenz system offers a rich source of examples 
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of various types of bifurcations that occur in dynamical systems. We dis- 
cuss some of these bifurcations in the next example where we rely heavily 
on Sparrow’s excellent numerical study of the Lorenz system [S]. Besides 
period-doubling bifurcations, the Lorenz system also exhibits a homoclinic 
loop bifurcation and the attendant chaotic motion in which the numerically 
computed solutions oscillate in a pseudo-random way, apparently forever; 
cf. [S] and Section 4.8. 


Example 5 (The Lorenz System). Consider the Lorenz system 


£ = 10(y — z) 
y= pr-—y—zz (8) 
z= ry — 82/3 


depending on the parameter p with p > 0. These equations are symmetric 
under the transformation (z, y, z) — (—z, —y, z). Thus, if (8) has a periodic 
orbit [ (such as the ones shown in Figures 11 and 12 below), it will also 
have a corresponding periodic orbit I’ which is the image of I under this 
transformation. Lorenz showed that there is an ellipsoid E? C R? which all 
trajectories eventually enter and never leave and that there is a bounded 
attracting set of zero volume within E? toward which all trajectories tend. 
For 0 < yp < 1, this set is simply the origin; i.e., for 0 < p < 1 there is only 
the one critical point at the origin and it is globally stable; cf. Problem 6 in 
Section 3.2 of Chapter 3. For p = 1, the origin is a nonhyperbolic critical 
point of (8) and there is a pitchfork bifurcation at the origin which occurs 
as yz increases through the bifurcation value » = 1. The two critical points 
which bifurcate from the origin are located at the points 


Ci 2 = (+2 V 2(u = 1)/3, +2 2(u _ 1)/3, pu im 1); 


cf. Problem 6 in Section 3.2 of Chapter 3. For yu > 1 the critical point 
at the origin has a one-dimensional unstable manifold W“(0) and a two- 
dimensional stable manifold W*(0). The eigenvalues ;,2 at the critical 
points C2 satisfy a cubic equation and they all have negative real part for 
1 <p < py where py = 470/19 ~ 24.74; cf. (S], p. 10. Parenthetically, we 
remark that A;,2 are both real for 1 < yp < 1.34 and there are complex pairs 
of eigenvalues at C2 for u > 1.34. The behavior near the critical points of 
(8) for relatively small pz (say 0 < p < 10) is summarized in Figure 8. Note 
that the z-axis is invariant under the flow for all values of p. 

As p increases, the trajectories in the unstable manifold at the origin W“ (0) 
leave the origin on increasingly larger loops before they spiral down to the 
critical points C2; cf. Figure 9. As y continues to increase, Sparrow’s 
numerical work shows that a very interesting phenomenon occurs in the 
Lorenz system at a parameter value p’ ~ 13.926: The trajectories in the 
unstable manifold W™(0) intersect the stable manifold W*(0) and form two 
homoclinic loops (which are symmetric images of each other); cf. Figure 10. 


374 4. Nonlinear Systems: Bifurcation Theory 


oa 


Figure 8. A pitchfork bifurcation occurs at the origin of the Lorenz system 
at the bifurcation value py = 1. 


w"(0) 
(0) 


6 \0) 
ws 


Figure 9. The stable and unstable manifolds at the origin for 
10< p< p' ~ 13.926. 


Homoclinic loop bifurcations are discussed in Section 4.8, although most 
of the theoretical results in that section are for two-dimensional systems 
where generically a single periodic orbit bifurcates from a homoclinic loop. 
In this case, a pair of unstable periodic orbits I|,2 also bifurcates from 
the two homoclinic loops as yu increases beyond yp’ as shown in Figure 11; 
however, something much more interesting occurs for the three-dimensional 
Lorenz system (8) which has no counterpart for two-dimensional systems. 
An infinite number of periodic orbits of arbitrarily long period bifurcate 
from the homoclinic loops as yz increases beyond yp’ and there is a bounded 
invariant set which contains all of these periodic orbits as well as an infinite 
number of nonperiodic motions; cf. Figure 6 in Section 3.2 and [S], p. 21. 
Sparrow refers to this type of homoclinic loop bifurcation as a “homoclinic 
explosion” and it is part of what makes the Lorenz system so interesting. 
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Figure 10. The homoclinic loop which occurs in the Lorenz system at the 
bifurcation value p’ ~ 13.926. 


Figure 11. A symmetric pair of unstable periodic orbits which result from 
the homoclinic loop bifurcation at p = p’. 


The critical points C2 each have one negative and two pure imagi- 
nary eigenvalues at the parameter value u = wy ~ 24.74. A subcritical 
Hopf bifurcation occurs at the nonhyperbolic critical points Ci,2 at the 
bifurcation value pp = py; cf. Section 4.4. Sparrow has computed the 
unstable periodic orbits I'),2 for several parameter values in the range 
13.926 ~ p’ < wp < pH ~ 24.74. The projection of I'2 on the (z, z)-plane is 
shown in Figure 12; cf. (S], p. 27. 

We see that the periodic orbit [2 approaches the critical point at the 
origin and forms a homoclinic loop as yz decreases to p’: For p > py, all 
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vp = 14.5 yp = 20.0 yp = 24.5 


Figure 12. Some periodic orbits in the one-parameter family of periodic 
orbits generated by the subcritical Hopf bifurcation at the critical point C4 
at the bifurcation value uy = py ~ 24.74. Reprinted with permission from 
Sparrow (Ref. [S]). 


three critical points are unstable and, at least for u > wy and p near py, 
there must be a strange invariant set within E? toward which all trajectories 
tend. In fact, from the numerical results in (S], it seems quite certain that, 
at least for p near wy, the Lorenz system (8) has a strange attractor as 
described in Example 4 in Section 3.2 of Chapter 3. This strange attractor 
actually appears at a value uw = pa = 24.06 < py at which value there is 
a heteroclinic connection of W“(0) and W°(I),2); cf. [S], p. 32. 

In order to describe some of the period-doubling bifurcations that occur 
in the Lorenz system and to see what happens to all of the periodic orbits 
born in the homoclinic explosion that occurs at p = p’ ~ 13.926, we next 
look at the behavior of (8) for large » (namely for p > poo & 313); cf. [S], 
Chapter 7. For » > 313, Sparrow’s work [S] indicates that there is only one 
periodic orbit . and it is stable and symmetric under the transformation 
(z,y,z) — (—2z,-y,z). For p > 313, the stable periodic orbit [.. and 
the critical points 0,C, and C2 make up the nonwandering set 92. The 
projection of the stable, symmetric periodic orbit [,. on the (z, z)-plane 
is shown in Figure 13 for wp = 350. At a bifurcation value p ~ 313, the 
nonhyperbolic periodic orbit undergoes a pitchfork bifurcation as described 
earlier in this section; cf. the bifurcation diagram in Figure 5(b). As pu 
decreases below pu. ~ 313, the periodic orbit ',, becomes unstable and two 
stable (nonsymmetric) periodic orbits are born; cf. the bifurcation diagram 
in Figure 15 below. The projection of one of these stable, nonsymmetric, 
periodic orbits on the (z,z)-plane is shown in Figure 13 for p = 260; 
cf. [S], p. 67. Recall that for each nonsymmetric periodic orbit I in the 
Lorenz system, there exists a corresponding nonsymmetric periodic orbit 
I’ obtained from I under the transformation (2, y,z) — (—z, —y, z). 

As p continues to decrease below pp = Uo, a period-doubling bifurcation 
occurs in the Lorenz system at the bifurcation value yp = po ~ 224. The 
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y= 350 w= 260 


Figure 13. The symmetric and nonsymmetric periodic orbits of the Lorenz 
system which occur for large 4. Reprinted with permission from Sparrow 


(Ref. [S}). 


projection of one of the resulting periodic orbits [2 whose period is ap- 
proximately equal to twice the period of the periodic orbit [, shown in 
Figure 13 is shown in Figure 14(a) for 4 = 222. There is another one Ih 
which is the symmetric image of ['g. This is not the end of the period- 
doubling story in the Lorenz system! Another period-doubling bifurcation 
occurs at a nonhyperbolic periodic orbit of the family [2 at the bifurca- 
tion value wp = pa ~ 218. The projection of one of the resulting periodic 
orbits [4 whose period is approximately equal to twice the period of the 
periodic orbit [2 (or four times the period of [,) is shown in Figure 14(b) 
for = 216.2. There is another one I, which is the symmetric image of Ty; 
cf. [S], p. 68. 


300 
250) 
180 
-40 -20 0 20 40 
wu = 222 u = 216.2 


Figure 14. The nonsymmetric periodic orbits which result from pe- 
riod-doubling bifurcations in the Lorenz system. Reprinted with permission 
from Sparrow (Ref. [S}). 
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214 313 p- 


Figure 15. The bifurcation diagram showing the pitchfork bifurcation and 
period-doubling cascade that occurs in the Lorenz system. Reprinted with 
permission from Sparrow (Ref. [S]). 


And neither is this the end of the story, for as yu continues to decrease 
below yz4, more and more period-doubling bifurcations occur. In fact, there 
is an infinite sequence of period-doubling bifurcations which accumulate 
at a bifurcation value yp = p* ~ 214. This is indicated in the bifurcation 
diagram shown in Figure 15; cf. [S], p. 69. This type of accumulation of 
period-doubling bifurcations is referred to as a period-doubling cascade. 
Interestingly enough, there are some universal properties common to all 
period-doubling cascades. For example the limit of the ratio 


UHn-1— Hn 
bn — Mn+." 


where py, is the bifurcation value at which the nth period-doubling bifur- 
cation occurs, is equal to some universal constant 6 = 4.6992...; cf., e.g., 
[S], p. 58. 

Before leaving this interesting example, we mention one other period- 
doubling cascade that occurs in the Lorenz system. Sparrow’s calculations 
[S] show that at » ~ 166 a saddle-node bifurcation occurs at a nonhyper- 
bolic periodic orbit. For 4 < 166, this results in two symmetric periodic 
orbits, one stable and one unstable. The stable, symmetric, periodic or- 
bit is shown in Figure 16 for » = 160. As p continues to decrease, first a 
pitchfork bifurcation and then a period-doubling cascade occurs, similar to 
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Figure 16. A stable, symmetric periodic orbit born in a saddle-node bi- 
furcation at 4 ~ 166; a stable, nonsymmetric, periodic orbit born in a 
pitchfork bifurcation at 4 ~ 154; and a stable, nonsymmetric, periodic 
orbit born in a period-doubling bifurcation at ~ ~ 148. Reprinted with 
permission from Sparrow (Ref. [S}). 


that discussed above. One of the stable, nonsymmetric, periodic orbits re- 
sulting from the pitchfork bifurcation which occurs at  ~ 154.5 is shown 
in Figure 16 for ~ = 148.5. One of the double-period, periodic orbits is 
also shown in Figure 16 for p = 147.5. The bifurcation diagram for the 
parameter range 145 < yu < 166 is shown in Figure 17; cf. [S], p. 62. 

There are many other period-doubling cascades and homoclinic explo- 
sions that occur in the Lorenz system for the parameter range 25 < pp < 145 
which we will not discuss here. Sparrow has studied several of these bifur- 
cations in [S]; cf. his summary on p. 99 of [S]. Many of the periodic or- 
bits born in the saddle-node and pitchfork bifurcations and in the period- 
doubling cascades in the Lorenz system (8) persist as yz decreases to the 
value 4 = pu’ ~ 13.926 at which the first homoclinic explosion occurs and 
which is where they terminate as yu decreases. Others terminate in other 
homoclinic explosions as yz decreases (or as pu increases). 

To really begin to understand the complicated dynamics that occur in 
higher dimensional systems (with n > 3) such as the Lorenz system, it is 
necessary to study dynamical systems defined by maps or diffeomorphisms 
such as the Poincaré map. While the numerical studies of Lorenz, Sparrow 
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145 148 184.4 166.07 # 


Figure 17. The bifurcation diagram showing the saddle-node and pitch- 
fork bifurcations and the period-doubling cascade that occur in the Lorenz 
system for 145 < py < 167. Reprinted with permission from Sparrow (Ref. 


[S}). 


and others have made it clear that the Lorenz system has some complicated 
dynamics which include the appearance of a strange attractor, the study of 
dynamical systems defined by maps rather than flows has made it possible 
to mathematically establish the existence of strange attractors for maps 
which have transverse homoclinic orbits; cf. [G/H] and [Wi]. Much of the 
success of this approach is due to the program of study of differentiable 
dynamical systems begun by Stephen Smale in the sixties. In particular, 
the Smale Horseshoe map, which occurs whenever there is a transverse 
homoclinic orbit, motivated much of the development of the modern theory 
of dynamical systems; cf., e.g. [Ru]. We shall discuss some of these ideas 
more thoroughly in Section 4.8; however, this book focuses on dynamical 
systems defined by flows rather than maps. 

Before ending this section on bifurcations at nonhyperbolic periodic or- 
bits, we briefly mention one last type of generic bifurcation that occurs at 
a periodic orbit when DP(xo, zo) has a pair of complex conjugate eigen- 
values on the unit circle. In this case, an invariant, two-dimensional torus 
results from the bifurcation and this corresponds to a Hopf bifurcation at 
the fixed point x9 of the Poincaré map P(x, 2); cf. (G/H], pp. 160-165 or 
[Ru], pp. 63 and 82. The idea of what occurs in this type of bifurcation is 
illustrated in Figure 18; however, an analysis of this type of bifurcation is 
beyond the scope of this book. 


PROBLEM SET 5 


1. Using equation (2), compute the derivative of the Poincaré map DP 
(r,,, 4) for the one-parameter family of periodic orbits 


Y,(t) = /u(cost, sin t)7 
of the system in Example 1. 
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Figure 18. A bifurcation at a nonhyperbolic periodic orbit which results 
in the creation of an invariant torus and which corresponds to a Hopf 
bifurcation of its Poincaré map. 


2. Verify the computations of the derivatives of the Poincaré maps ob- 
tained in Examples 2, 3 and 4 by using equation (2). 


3. Sketch the surfaces of periodic orbits in Examples 3 and 4. 
4. Write the planar system 
& = —y + 2[p — (r? — 1)7][u — 4(r? — 1)? 
y=rtylp—(r? —1)|[p—4(r? - 1)" 


in polar coordinates and show that for all 4 > O there are one- 
parameter families of periodic orbits given by 


z(t) = V1 + p!/2(cost, sint)” 
and 
yi (t) = 1+ p'/2/2(cost, sint)?. 


Using equation (2), compute the derivative of the Poincaré maps, 


DP(V1 + p'/2, p) and DP(./1 + p'/2/2, ), for these families. And 


draw the bifurcation diagram. 
5. Show that the vector field f defined by the right-hand side of 
= —-y+2{p—(r —-1)?] 
y=rtyly—(r—1)7] 


is in C'(R?) but that f ¢ C?(R?). Write this system in polar co- 
ordinates, determine the one-parameter families of periodic orbits, 
and draw the bifurcation diagram. How do the bifurcations for this 
system compare with those in Example 2? 
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6. For the functions (r, uz) given below, write the system (5) in Sec- 
tion 4.4 in polar coordinates in order to determine the one-parameter 
families of periodic orbits of the system. Draw the bifurcation dia- 
gram in each case and determine the various types of bifurcations. 


(a) o(r, Hu) = (r-1)(r-p-1) 

(b) P(r, 4) = (r-1)(r-—p—-1)(r +4) 

(c) P(r, ph) = (r -1)(r-—w-1)(r+H+1) 

(d) P(r, yu) = (uw — 1)(r? — 1)[u — 1 — (r? — 1)? 


7. (One-dimensional maps) A map P: R — R is said to have a nonhy- 
perbolic fixed point at x = Zo if P(z9) = Zo and |DP(zo)| = 1. 


(a) Show that the map P(z, ») = » — x” has a nonhyperbolic fixed 
point z = —1/2 at the bifurcation value pp = —1/4. Sketch 
the bifurcation diagram, i.e. sketch the locus of fixed points of 
P, where P(z,) = 2, in the (yz, 2) plane and show that the 
map P(z, ») has a saddle-node bifurcation at the point (y,z) = 
(-—1/4, -1/2). 

(b) Show that the map P(z,) = pz(1 — z) has a nonhyperbolic 
fixed point at x = 0 at the bifurcation value u = 1. Sketch the 
bifurcation diagram in the (u,2z) plane and show that P(z, 1) 
has a transcritical bifurcation at the point (w,z) = (1,0). 


8. (Two-dimensional maps) A map P: R? — R? is said to have a non- 
hyperbolic fixed point at x = Xo if P(xo9) = x9 and DP(xo) has an 
eigenvalue of unit modulus. 


(a) Show that the map P(x, ) = (u—=2?, 2y)? has a nonhyperbolic 
fixed point at x = (—1/2,0)7 at the bifurcation value p = —1/4. 
Sketch the bifurcation diagram in the (yz, z) plane and show that 
P(x, ) has a saddle-node bifurcation at the point (u,z,y) = 
(—1/4, -1/2,0). 

(b) Show that the map P(x,y) = (y,—z/2 + wy — y®)? has a 
nonhyperbolic fixed point at x = O at the bifurcation value 
p. = 3/2. Sketch the bifurcation diagram in the (u,z) plane 
and show that P(x, ) has a pitchfork bifurcation at the point 


(u, x,y) = (3/2, 0,0). 
Hint: Follow the procedure outlined in Problem 7(a). 


9. Consider the one-dimensional map P(z, ») = »— 2? in Problem 7(a). 
Compute DP(z, u) (where D stands for the partial derivative with 
respect to z) and show that along the upper branch of fixed points 


given by x = (-1+ /1+ 4u)/2 we have 
DP (—=* r i+ .u) ee | 
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at the bifurcation value up = 3/4. Thus, for 4 = 3/4, the map P(z, ) 
has a nonhyperbolic fixed point at z = 1/2 and DP(1/2,3/4) = 
—1. We therefore expect a period-doubling bifurcation or a so-called 
flip bifurcation for the map P(z, 4) to occur at the point (0,20) = 
(3/4,1/2) in the (u,2) plane. Show that this is indeed the case by 
showing that the iterated map 


P?(x, 4) = — (u— 27)? 
has a pitchfork bifurcation at the point (419,20) = (3/4,1/2); i.e., 
show that the conditions (4) in Section 4.2 are satisfied for the map 
F = P?. (These conditions reduce to F(z, 40) = 20, DF (zo, Ho) = 
l, D? F(zo, Ho) = 0, D° F(z, Ho) # 0, F,,(zo, Ho) = 0, and DF, (zo, Ho) 
# 0.) Show that the pitchfork bifurcation for F = P? is super- 
critical by showing that for 4 = 1, the equation P?(z,u) = z has 
four solutions. Sketch the bifurcation diagram for P?, i.e. the locus 
of points where P?(z,u) = z and show that this implies that the 


map P(z,) has a period-doubling or flip bifurcation at the point 
(#0, Xo) = (3/4, 1/2). 


10. Show that the one-dimensional map P(z,) = px(1 — x) of Prob- 
lem 7(b) has a nonhyperbolic fixed point at z = 2/3 at the bifur- 
cation value » = 3 and that DP(2/3,3) = —1. Show that the map 
P(z, ») has a flip bifurcation at the point (40,20) = (3, 2/3) in the 
(4,2) plane. Sketch the bifurcation diagram in the (4,2) plane. 


11. Why can’t the one-dimensional maps in Problems 9 and 10 be the 
Poincaré maps of any two-dimensional system of differential equa- 
tions? Note that they could be the Poincaré maps of a higher di- 
mensional system (with n > 3) where z is the distance along the 
one-dimensional manifold W°(I) C & where the center manifold of a 
periodic orbit I of the system intersects a hyperplane © normal to I. 


4.6 One-Parameter Families of Rotated Vector 
Fields 


We next study planar analytic systems 
x = f(x, 1) (1) 


which depend on the parameter » € R in a very specific way. We assume 
that as the parameter yu increases, the field vectors f(x, 4) or equivalently 
(P(z,y, 4), Q(z, y,))? all rotate in the same sense. If this is the case, 
then the system (1) is said to define a one-parameter family of rotated 
vector fields and we can prove some very specific results concerning the 
bifurcations and global behavior of the limit cycles and separatrix cycles of 
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such a system. These results were established by G. D. F. Duff [7] in 1953 
and were later extended by the author (23], [63]. 


Definition 1. The system (1) with f € C!(R? x R) is said to define a 
one-parameter family of rotated vector fields if the critical points of (1) are 
isolated and at all ordinary points of (1) we have 


P Q 
Ps Qu 


If the sense of the above inequality is reversed, then the system (1) is said 
to define a one-parameter family of negatively rotated vector fields. 

Note that the condition (2) is equivalent to f Af, > 0. Since the angle 
that the field vector f = (P,Q)? makes with the z-axis 


> 0. (2) 


© =tan7! S, 
it follows that 
80 _ PQu- QP, 
Ou — P24 Q2 — Q? 


Hence, condition (2) implies that at cach ordinary point x of (1), where 
P? + Q? £0, the field vector f(x, 4) at x rotates in the positive sense as ps 
increases. If in addition to the condition (2) at each ordinary point of (1) 
we have tan O(z,y, uz) — +00 as wp — +00, or if O(z, y, uw) varies through 
m radians as yu varies in R, then (1) is said to define a semicomplete family 
of rotated vector fields or simply a semicomplete family. Any vector field 


Xx te 
F(x) = 
= (yey 
can be embedded in a semicomplete family of rotated vector fields 


& = X(z,y) — pY(z,y) (3) 
y = pX(z,y) + Y(z,y) 
with parameter yp € R. And as Duff pointed out, any vector field F = 


(X,Y)? can also be embedded in a “complete” family of rotated vector 
fields 

z= X(z,y)cosp— Y(z,y) sing 4) 

y = X(z,y)sinu + Y(z, y) cosy ( 
with parameter yz € (—7, 7]. The fainily of rotated vector fields (4) is called 
complete since each vector in the vector field defined by (4) rotates through 
2x radians as the parameter yp varices in (—7,7]. Duff also showed that 
any nonsingular transformation of coordinates with a positive Jacobian 
determinant takes a semicomplete (or complete) family of rotated vector 
fields into a semicomplete (or complete) family of rotated vector fields; 
cf. Problem 1. We first establish the result that limit cycles of any one- 
parameter family of rotated vector ficlds expand or contract monotonically 
as the parameter y increases. In order to establish this result, we first prove 
two lemmas which are of some interest in themselves. 
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Lemma 1. Cycles of distinct fields of a semicomplete family of rotated 
vector fields do not intersect. 


Proof. Suppose that [',,, andT’,,, are two cycles of the distinct vector fields 
F(j;) and F(y2) defined by (1). Suppose for definiteness that 4; < 2 and 
that the cycles [,, and I, have a point in common. Then at that point 


Arg F(y) < Arg F(2); 


i.e., F(u2) points into the interior of T',,. But according to Definition 1, 
this is true at every point on I',,,. Thus, once the trajectory I’,,, enters the 
interior of the Jordan curve I’,,,, it can never leave it. This contradicts the 
fact that the cycle I’, is a closed curve. Thus, [,, and IT, have no point 
in common. 


Lemma 2. Suppose that the system (1) defines a one-parameter family 
of rotated vector fields. Then there exists an outer neighborhood U of any 
eternally stable cycle T',, of (1) such that through every point of U there 
passes a cycle T,, of (1) where u < po ifT,, is positively oriented and p > 
Ho if ly, ts negatively oriented. Corresponding statements hold regarding 
unstable cycles and inner neighborhoods. 


Proof. Let N,, denote the outer, €g-neighborhood of I’, and let x be 
any point of N, with 0 < € < é€g. Let I'(x, uz) denote the trajectory of (1) 
passing through the point x at time t = 0. Let @ be a line segment normal 
tol, which passes through x. If €9 and | — ol are sufficiently small, 2 is a 
transversal to the vector field F(z) in N,,. Let P(x, 2) be the Poincaré map 
for the cycle T’,,, with x € @. Then since I’, is externally stable, meets x, 
P(x, po) and I’,,, in that order. Furthermore, by continuity, P(x, 4) moves 
continuously along @ as yp varies in a small neighborhood of jo, and for 
|4t — Ho| sufficiently small, the arc of I'(x, ~) from x to P(x, 2) is contained 
in N.,. We shall show that for e > 0 sufficiently small, there is a pp < pio if 
Tu is positively oriented and a p > po if I',, is negatively oriented such 
that P(x,u) = x. The result stated will then hold for the neighborhood 
U = N.. The trajectories are differentiable, rectifiable curves. Let s denote 
the arc length along I(x, jo) measured in the direction of increasing ¢ and 
let n denote the distance taken along the outer normals to this curve; cf. 
([A-II], p. 110. In N,, the angle function ©(x, 1) satisfies a local Lipschitz 
condition 
|9(s, 1, 4) — O(s, n2, 4)| < M|ni — nol 

for some constant M independent of s,n, u and € < €9. Also the continuous 
positive function 06/0 has in N, a positive lower bound m independent of 
e. Let n = h(s, ») be the equation of I(x, 4) so that h(s, 49) = 0. Suppose 
for definiteness that I',,, is positively oriented and let ys decrease from pio. 
It then follows that for o — pu sufficiently small 


> Slm(uo — u) — Mh. 
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Integrating this differential inequality (using Gronwall’s Lemma) from 0 to 
L, the length of the arc I(x, ) from x to P(x, 1), we get 


h(L, u) > 5>(uo — w)[1 — e“ *?) = K (uo — 1). 


Thus, we see that h(L, pu) > € for wo — wp > €/K. But this implies that 
for such a value of u the point P(x, ) has moved outward from I, on 
£ past x. Since the motion of P(x, ) along @ is continuous, there exists 
an intermediate value yw, of uw such that P(x, )) = x. It follows that 
[ui — Ho| < ¢/K. If € > 0 is sufficiently small, ['(x, ~) remains in N,, for 
Ht << wo. This proves the result. If [’,,, is negatively oriented we need 
only write p — po in place of po — py in the above proof. 


The next theorem follows from Lemmas 1 and 2. Cf. [7]. 


Theorem 1. Stable and unstable limit cycles of a one-parameter family of 
rotated vector fields (1) expand or contract monotonically as the parameter 
yt varies in a fixed sense and the motion covers an annular neighborhood of 
the initial position. 


The following table determines the variation of the parameter p which 
causes the limit cycle I’,, to expand. The opposite variation of yz will cause 
r,, to contract. Au > 0 indicates increasing yp. The orientation of I’, is 
denoted by w and the stability of T',, by o where (+) denotes an unstable 
limit cycle and (—) denotes a stable limit cycle. 


Figure 1. The variation of the parameter y which causes the limit cycle I’, 
to expand. 


The next theorem, describing a saddle-node bifurcation at a semistable 
limit cycle of (1), can also be proved using Lemmas 1 and 2 as in [7]. And 
since f Af, = PQ, — QP, > 0, it follows from equation (6) in Section 4.5 
that the partial derivative of the Poincaré map with respect to the param- 


eter yz is not zero; i.e., 
d(n, 
Od(n, p) £0 
Ou 
where d(n, ) is the displacement function along @ and n is the distance 
along the transversal @. Thus, by the implicit function theorem, the relation 
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d(n, 2) = 0 can be solved for p as a function of n. It follows that the only 
bifurcations that can occur at a multiple limit cycle of a one-parameter 
family of rotated vector fields are saddle-node bifurcations. 


Theorem 2. A semistable limit cycle T, of a one-parameter family of 
rotated vector fields (1) splits into two simple limit cycles, one stable and 
one unstable, as the parameter p is varied in one sense and it disappears 
as pt is varied in the opposite sense. 


The variation of 4 which causes the bifurcation of I’, into two hyperbolic 
limit cycles is determined by the table in Figure 1 where in this case o 
denotes the external stability of the semistable limit cycle [',. 

A lemma similar to Lemma 2 can also be proved for separatrix cycles 
and graphics of (1) and this leads to the following result. Cf. [7]. 


Theorem 3. A separatriz cycle or graphic T9 of a one-parameter family of 
rotated vector fields (1) which is isolated from other cycles of (1) generates 
a unique limit cycle on its interior or exterior (which is of the same stability 
as Io on its interior or exterior respectively) as the parameter yp is varied 
in a suitable sense as determined by the table in Figure 1. 


Recall that in the proof of Theorem 3 in Section 3.7 of Chapter 3, it 
was shown that the Poincaré map is defined on the interior or exterior 
of any separatrix cycle or graphic of (1) and this is the side on which a 
limit cycle is generated as p varies in an appropriate sense. The variation 
of u which causes a limit cycle to bifurcate from the separatrix cycle or 
graphic is determined by the table in Figure 1. In this case, o denotes 
the external stability when the Poincaré map is defined on the exterior of 
the separatrix cycle or graphic and it denotes the negative of the internal 
stability, i.e., (—) for an interiorly unstable separatrix cycle or graphic and 
(+) for an interiorly stable separatrix cycle or graphic, when the Poincaré 
map is defined on the interior of the separatrix cycle or graphic. 

For example, if for 4 = po we have asimple, positively oriented (w = +1), 
separatrix loop at a saddle which is stable on its interior (so that o = +1), 
a unique stable limit cycle is generated on its interior as yz increases from 
Lto (by Table 1); cf. Figure 2. 


H < Ho H = Up H > Uy 


Figure 2. The generation of a limit cycle at a separatrix cycle of (1). 
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cD ED 


H< Ho H = Ho H > Hy 


Figure 3. The generation of a limit cycle at a graphic of (1). 


As another example, consider the case where for 4 = po we have a graphic 
I‘o composed of two separatrix cycles [; and [2 at a saddle point as shown 
in Figure 3. The orientation is negative sow = —1. The graphic is externally 
stable so 09 = —1. Thus, by Table 1 and Theorem 3, a unique, stable limit 
cycle is generated by the graphic [9 on its exterior as p increases from po. 
Similarly, the separatrix cycles , and Ig are internally stable so that o 
and o2 = +1. Thus, by Table 1 and Theorem 3, a unique, stable limit cycle 
is generated by each of the separatrix cycles [; and Ig on their interiors 
as ys decreases from po. Cf. Figure 3. 

Consider one last example of a graphic [9 which is composed of two 
separatrix cycles [; and [2 with I, on the interior of Ig as shown in 
Figure 4 with pz = po. In this case, I, is positively oriented (so that w, = 
+1) and is internally stable (so that o,; = +1). Thus, I) generates a unique, 
stable limit cycle on its interior as yz increases from po. Similarly, Tq is 
negatively oriented (so that w2 = —1) and it is externally stable (so that 
o2 = —1). Thus, [2 generates a unique, stable limit cycle on its exterior 
as p increases from po. And the graphic Ip is negatively oriented (so that 
wo = —1) and it is internally stable (so that o9 = +1). Thus [po generates a 
unique, stable limit cycle on its interior as 4. decreases from jp. Cf. Figure 4. 


U< Ho H = Uy H > Up 


Figure 4. The generation of a limit cycle at a graphic of (1). 
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Specific examples of these types of homoclinic loop bifurcations are given 
in Section 4.8 where homoclinic loop bifurcations are discussed for more 
general vector fields. Of course, we do not have the specific results for more 
general vector fields that we do for the one-parameter families of rotated 
vector fields being discussed in this section. 

Theorems 1 and 2 above describe the local behavior of any one-parameter 
family of limit cycles generated by a one-parameter family of rotated vector 
fields (1). The next theorem, proved by Duff [7] in 1953 and extended 
by the author in [24] and [63], establishes a result which describes the 
global behavior of any one-parameter family of limit cycles generated by a 
semicomplete analytic family of rotated vector fields. Note that in the next 
theorem, as in Section 4.5, the two limit cycles generated at a saddle-node 
bifurcation at a semistable limit cycle are considered as belonging to the 
same one-parameter family of limit cycles since they are both defined by the 
same branch of the relation d(n, uz) = 0 where d(n, p) is the displacement 
function. 


Theorem 4. Let T,, be a one-parameter family of limit cycles of a semi- 
complete analytic family of rotated vector fields with parameter p and let G 
be the annular region covered by l,, as varies in R. Then the inner and 
outer boundaries of G consist of either a single critical point or a graphic 
of (1) on the Bendizson sphere. 


We next cite a result describing a Hopf bifurcation at a weak focus of 
a one-parameter family of rotated vector fields (1). We assume that the 
origin of the system (1) has been translated to the weak focus, i.e., that 
the system (1) has been written in the form 


x = A(u)x + F(x, 1) (5) 


as in Section 2.7 of Chapter 2. Duff [7] showed that if (5) defines a semicom- 
plete family of rotated vector fields, then if det A(y19) 4 0 at some po € R, 
it follows that det A(z) 4 0 for all hE R. 


Theorem 5. Assume that F € C?(R* x R), that the system (5) defines 
a one-parameter family of rotated vector fields with parameter » € R, that 
det A(pio) > 0, trace A(o) = 0, trace A(u) #0, and that the origin is not 
a center of (5) for w = po. It then follows that the origin of (5) absorbs or 
generates exactly one limit cycle at the bifurcation value pp = po. 


The variation of y from po, Ay, which causes the bifurcation of a limit 
cycle, is determined by the table in Figure 1 where o denotes the stability 
of the origin of (5) at 4 = po (which is the same as the stability of the 
bifurcating limit cycle) and w denotes the orientation of the bifurcating 
limit cycle which is the same as the @-direction in which the flow swirls 
around the weak focus at the origin of (5) for 4 = po. Note that if the 
origin of (5) is a weak focus of multiplicity one, then the stability of the 


390 4. Nonlinear Systems: Bifurcation Theory 


origin is determined by the sign of the Liapunov number ¢ which is given 
by equation (3) or (3’) in Section 4.4. 

We cite one final result, established recently by the author [25], which 
describes how a one-parameter family of limit cycles, I’, generated by a 
semicomplete analytic family of rotated vector fields with parameter pu € R, 
terminates. The termination of one-parameter families of periodic orbits of 
more general vector fields is considered in the next section. In the statement 
of the next theorem, we use the quantity 

Pu = max [x| 
to measure the maximum distance of the limit cycle I’, from the origin 
and we say that the orbits in the family become unbounded as p — pio if 


Pp — OO aS fb — Ho. 


Theorem 6. Any one-parameter family of limit cycles T,, generated by a 
semi-complete family of rotated vector fields (1) etther terminates as the 
parameter yu or the orbits in the family become unbounded or the family 
terminates at a critical point or on a graphic of (1). 


Some typical bifurcation diagrams of global one-parameter families of 
limit cycles generated by a semicomplete family of rotated vector fields are 
shown in Figure 5 where we plot the quantity p, versus the parameter p. 


y Pn 
0 0 Hy oO Fi Fe 


Figure 5. Some typical bifurcation diagrams of global one-parameter fam- 
ilies of limit cycles of a one-parameter family of rotated vector fields. 


In the first case in Figure 5, a one-parameter family of limit cycles is 
born in a Hopf bifurcation at a critical point of (1) at ~ = 0 and it expands 
monotonically as 4 — oo. In the second case, the family is born at a Hopf 
bifurcation at 4 = 0, it expands monotonically with increasing p, and it 
terminates on a graphic of (1) at 4 = 4. In the third case, there is a Hopf 
bifurcation at 4 = p, a saddle-node bifurcation at 4 = 0, and the family 
expands monotonically to infinity, i.e., p, —* 00, as zp — pe. 

We end this section with some examples that display various types of 
limit cycle behavior that occur in families of rotated vector fields. Note 
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that many of our examples are of the form of the system 

t= -y+2[¥(r) — p] 

y=2+y[¥(r) - yp] (6) 
which forms a one-parameter family of rotated vector fields since 


P Q 
Ph Qu 


at all ordinary points of (6). The bifurcation diagram for (6) is given by 
the graph of the relation r[~(r) — u] = 0 in the region r > 0. 


=r?>0 


Example 1. The system 
&= —pr —y+a2r? 
y=r-pytyr’ 


has the form of the system (6) and therefore defines a one-parameter family 
of rotated vector fields. The only critical point is at the origin, det A(z) = 
1+ p? > 0, and trace A(z) = —2pu. According to Theorem 5, there is a 
Hopf bifurcation at the origin at ~ = 0; and since for 4 = 0 the origin is 
unstable (since 7 = r® for 4 = 0) and positively oriented, it follows from 
the table in Figure 1 that a limit cycle is generated as py increases from 
zero. The bifurcation diagram in the (y,1r)-plane is given by the graph of 
r(r? — yu) = 0; cf. Figure 6. 


Figure 6. A Hopf bifurcation at the origin. 


Example 2. The system 
z= —y + 2[-p + (r? — 1)*] 
y=rt+yl—pt (r? -1)7] 


forms a one-parameter family of rotated vector fields with parameter p. 
The origin is the only critical point of this system, det A(u) = 1+ (1 —- 
pz)? > 0, and trace A(z) = 2(1 — p). According to Theorem 5, there is 
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Mm 


Figure 7. The bifurcation diagram for the system in Example 2. 


a Hopf bifurcation at the origin at ~ = 1, and since the origin is stable 
(cf. equation (3) in Section 4.4) and positively oriented, according to the 
table in Figure 1, a one-parameter family of limit cycles is generated as py 
decreases from one. The bifurcation diagram is given by the graph of the 
relation r[—p + (r? — 1)?] = 0; cf. Figure 7. We see that there is a saddle- 
node bifurcation at the semistable limit cycle p(t) = (cost,sint)? at the 
bifurcation value 4 = 0. The one-parameter family of limit cycles born at 
the Hopf bifurcation at 4 = 1 terminates as the parameter and the orbits 
in the family increase without bound. 

The system considered in the next example satisfies the condition (2) in 
Definition 1 except on a curve G(z, y) = 0 which is not a trajectory of (1). 
The author has recently established that all of the results in this section 
hold for such systems which are referred to as one-parameter families of 
rotated vector fields (mod G = 0); cf. [23] and [63]. 


Example 3. Consider the system 


z£=—-rt+y" 

y= —pot+yt py — zy. 
We have 

. : =(-r+y’)?>0 


except on the parabola z = y* which is not a trajectory of this system. The 
critical points are at the origin, which is a saddle, and at (1, +1). Since 


=) 2 


we have det A(jz) = 2 > 0 and tr A(z) = —1 + 2p at the critical points 
(1, +1). Since this system is invariant under the transformation (z, y, un) — 
(x, —y, —y), we need only consider yp > 0. According to Theorem 5, there is 
a Hopf bifurcation at the critical point (1, 1) at ~» = 1/2. By equation (3’) 
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2.4 B*.5I 


f*.S2 oh? 6 


Figure 8. Phase portraits for the system in Example 3. 


in Section 4.4, 0 < 0 for » = 1/2 and therefore since w = —1, it follows from 
the table in Figure 1 that a unique limit cycle is generated at the critical 
point (1, 1) as uz increases from = 1/2. This stable, negatively oriented 
limit cycle expands monotonically with increasing yz until it intersects the 
saddle at the origin and forms a separatrix cycle at a bifurcation value up = 
44, which has been numerically determined to be approximately .52. The 
bifurcation diagram is the same as the one shown in the second diagram in 
Figure 5. Numerically drawn phase portraits for various values of pz € [.4, .6] 
are shown in Figure 8. 


Remark. It was stated by Duff in [7] and proved by the author in [63] that 
a rotation of the vector field causes the separatrices at a hyperbolic saddle 
to precess in such a way that, after a (positive) rotation of the field vectors 
through 7 radians, a stable separatrix has turned (in the positive sense 
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about the saddle point) into the position of one of the unstable separatrices 
of the initial field. In particular, a rotation of a vector field with a saddle 
connection will cause the saddle connection to break. 


PROBLEM SET 6 


1. Show that any nonsingular transformation with a positive Jacobian 
determinant takes a one-parameter family of rotated vector fields into 
a one-parameter family of rotated vector fields. 


2. (a) Show that the system 


£=prt+y—a2r’ 


y= zt py—yr? 
defines a one-parameter family of rotated vector fields. Use The- 
orem 5 and the table in Figure 1 to determine whether the Hopf 


bifurcation at the origin of this system is subcritical or super- 
critical. Draw the bifurcation diagram. 


(b 


— 


Show that the system 
t= pr —y + (ax — by)(x? + y”) + O(|x|*) 
y=x+ py t (ay + br)(z? + y*) + O(|x|*) 


of Problem 1(b) in Section 4.4 defines a one-parameter family 
of negatively rotated vector fields with parameter uw € R in 
some neighborhood of the origin. Determine whether the Hopf 
bifurcation at the origin is subcritical or supercritical. Hint: 
From equation (3) in Section 4.4, it follows that o = 97a. 


3. Show that the system 
g=y(1+z)+prt+(y—1)2? 
j = -2(1 +2) 


satisfies the condition (2) except on the vertical lines z = 0 and z = 
—1. Use the results of this section to show that there is a subcritical 
Hopf bifurcation at the origin at the bifurcation value » = 0. How 
must the one-parameter family of limit cycles generated at the Hopf 
bifurcation at 4 = 0 terminate according to Theorem 6? Draw the 
bifurcation diagram. 


4. Draw the global phase portraits for the system in Problem 3 for 
—3 < » < 1. Hint: There is a saddle-node at the point (0,+1,0) at 
infinity. 


5. Draw the global phase portraits for the system in Example 3 for the 
parameter range —2 < yw < 2. Hint: There is a saddle-node at the 
point (+1,0,0) at infinity. 
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6. Show that the system 


t=yty’ 
y = —20 + py — zy + (ut ly’ 
satisfies condition (2) except on the horizontal lines y = 0 and y = —1. 


Use the results of this section to show that there is a supercritical 
Hopf bifurcation at the origin at the value 4 = 0. Discuss the global 
behavior of this limit cycle. Draw the global phase portraits for the 
parameter range —1 <p <1. 


7. Show that the system 


t=—ctyty’ 
y= —pr+(u+4)y + (u—2)y? — zy 


satisfies the condition (2) except on the curve z = y + y” which is 
not a trajectory of this system. Use the results of this section to show 
that there is a subcritical Hopf bifurcation at the upper critical point 
and a supercritical Hopf bifurcation at the lower critical point of this 
system at the bifurcation value 4 = 1. Discuss the global behavior of 
these limit cycles. Draw the global phase portraits for the parameter 
range 0 < p< 4. 


4.7 The Global Behavior of One-Parameter 
Families of Periodic Orbits 


In this section we discuss the global behavior of one-parameter families of 
periodic orbits of a system of differential equations 


x = f(x, p) (1) 


depending on a parameter » € R. We assume that f is a real, analytic 
function of x and p and that the components of f are relatively prime. 
The global behavior of families of periodic orbits has been a topic of recent 
research interest. We cite some of the recent results on this topic which 
generalize the corresponding results in Section 4.6 and, in particular, we 
cite a classical result established in 1931 by A. Wintner referred to as 
Wintner’s Principle of Natural Termination. 

In Section 4.6 we saw that the only kind of bifurcation that occurs at 
a nonhyperbolic limit cycle of a family of rotated vector fields is a saddle- 
node bifurcation. We regard the two limit cycles generated at a saddle- 
node bifurcation as belonging to the same one-parameter family of limit 
cycles; e.g., we can use the distance along a normal arc to the family as 
the parameter. For families of rotated vector fields, we have the result 
in Theorem 6 of Section 4.6 that any one-parameter family of limit cycles 
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expands or contracts monotonically with the parameter until the parameter 
or the size of the orbits in the family becomes unbounded or until the family 
terminates at a critical point or on a graphic of (1). 

The next examples show that we cannot expect this simple type of be- 
havior in general. The first example shows that, in general, limit cycles do 
not expand or contract monotonically with the parameter. This permits 
“cyclic families” to occur as illustrated in the second example. And the 
third example shows that several one-parameter families of limit cycles can 
bifurcate from a nonhyperbolic limit cycle. 

Example 1. Consider the system 

é=-yta[(x-y)?+y?-1] 

y=rtyl(z—p)?+y’ - 1]. 
According to Theorem 1 and equation (3) in Section 4.4, there is a one- 
parameter family of limit cycles generated in a Hopf bifurcation at the 
origin as p increases from the bifurcation value p = —1. This family termi- 
nates in a Hopf bifurcation at the origin as the parameter p approaches the 
bifurcation value yp = 1 from the left. Some of the limit cycles in this one- 
parameter family of limit cycles are shown in Figure 1 for the parameter 
range 0 < p < 1. Since this system is invariant under the transformation 
(x,y, 2) — (—2z,—-y, —p), the limit cycles for 4 € (—1,0] are obtained by 
reflecting those in Figure 1 about the origin. We see that the orbits do 
not expand or contract monotonically with the parameter. The bifurcation 
diagram for this system is shown in Figure 2. 


Remark 1. Even though the growth of the limit cycles in a one-parameter 
family of limit cycles is, in general, not monotone, we can still determine 
whether a hyperbolic limit cycle 9 expands or contracts at a point xo € Io 
by computing the rate of change of the distance s along a normal @ to the 
limit cycle [9: x = ¥o(t) at the point x9 = Yo(to); i.e. 


ds d,,(0, Lo) 


du d4(0, Ho) 
where d(s, 4) = P(s, 1) — s is the displacement function along @, 
Ti 
d,(0, 0) = ola ° V-E(Yo(t) mo)at —1 
by Theorem 2 in Section 3.4 of Chapter 3, and 


d,(0, 15) = eat fo eleg VPC ole) maddr 
on If(xo, Ho)! Sto 


as in equation (6) in Section 4.5. All of the quantities which determine the 
sign of ds/dy, i.e., which determine whether Ip expands or contracts at the 
point Xo = y(to) € To, have the same sign along Ip except the integral 


Totto pTo+t 
Ip = / ele * VEL HoArg A £,(-y0(t), wo)dt. 
t 


0 


fA £4 (Yo(t), Mo)dt 
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Figure 1. Part of the one-parameter family of limit cycles of the system in 
Example 1. 


Figure 2. The bifurcation diagram for the system in Example 1. 


And the sign of this integral determines whether the limit cycle Ip in the 
one-parameter family of limit cycles is expanding or contracting with the 
parameter yz according to the following table which is similar to the table 
in Figure 1 of Section 4.6. The following table determines the change in 
Ap = »— Ho which causes an expansion of the limit cycle at the point 
Xo = ¥(to) € To. As in Section 4.6, w denotes the orientation of 9 and a 
its stability. 
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For a one-parameter family of rotated vector fields, f Af, > 0 and therefore 
the integral Ip is positive at all points on 9. The above formula for ds/dyu 
is then equivalent to a formula given by Duff [7] in 1953. 


Example 2. Consider the system 


z= —y+2((r? — 2)? +p? - YJ 
y=x+y((r? — 2)? + p? — 1). 


The bifurcation diagram is given by the graph of the relation (r? — 2)? + 
p2 —1 =0 in the (y,7)-plane. It is shown in Figure 3. We see that there are 
saddle-node bifurcations at the nonhyperbolic periodic orbits represented 
by y(t) = V2(cost,sint)? at the bifurcation values yp = +1. This type of 
one-parameter family of periodic orbits is called a cyclic family. Loosely 
speaking a cyclic family is one that has a closed-loop bifurcation diagram. 


Figure 3. The bifurcation diagram for the system in Example 2. 


Example 3. Consider the analytic system 


z= —y+a[p—-(r? -1)"I[e - (r? - 1)[e + (r? - 1) 
y=rtyly—(r?—1)I[e— (r? — 1)][e + (7? - 1). 
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The bifurcation diagram is given by the graph of the relation 
[w — (r? — 1)7)[u — (r? — 1) + (r? - 1)] =0 


Figure 4. The bifurcation diagram for the system in Example 3. 


in the (y,7r)-plane with r > 0. It is shown in Figure 4. The main point of 
this rather complicated example is to show that we can have several one- 
parameter families of limit cycles passing through a nonhyperbolic periodic 
orbit. In this case there are three one-parameter families passing through 
the point (0, 1) in the bifurcation diagram. There is also a Hopf bifurcation 
at the origin at the bifurcation value yp = —1. 

As in the last example, the bifurcation diagram can be quite compli- 
cated; however, in 1931 A. Wintner [34] showed that, in the case of analytic 
systems (1), there are at most a finite number of one-parameter families 
of periodic orbits that bifurcate from a nonhyperbolic periodic orbit and 
any one-parameter family of periodic orbits can be continued through a 
bifurcation in a unique way. Winter used Puiseux series in order to estab- 
lish this result. Any one-parameter family of periodic orbits generates a 
two-dimensional surface in R” x R where each cross-section of the sur- 
face obtained by holding pz constant, ~ = po, is a periodic orbit [9 of 
(1); cf. Figure 3 in Section 4.5. In this context, a cyclic family is simply 
a two-dimensional torus in R” x R. If a one-parameter family of periodic 
orbits of an analytic system (1) cannot be analytically extended to a larger 
one-parameter family of periodic orbits, it is called a maximal family. The 
question of how a maximal one-parameter family of periodic orbits termi- 
nates is answered by the following theorem proved by A. Wintner in 1931. 
Cf. [34]. 


Theorem 1 (Wintner’s Principle of Natural Termination). Any 
maximal, one-parameter family of periodic orbits of an analytic system (1) 
is either cyclic or it terminates as either the parameter 1, the periods T,, 
or the periodic orbits T,, in the family become unbounded; or the family 
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terminates at an equilibrium point or at a period-doubling bifurcation orbit 
of (1). 


As was pointed out in Section 4.5, period-doubling bifurcations do not 
occur in planar systems and it can be shown that the only way that the 
periods T,, of the periodic orbits I’, in a one-parameter family of periodic 
orbits of a planar system can become unbounded is when the orbits I, 
approach a graphic or degenerate critical point of the system. Hence, for 
planar analytic systems, we have the following more specific result, recently 
established by the author (25, 39], concerning the termination of a maximal 
one-parameter family of limit cycles. 


Theorem 2 (Perko’s Planar Termination Principle). Any mazimal, 
one-parameter family of limit cycles of a planar, relatively prime, analytic 
system (1) is either cyclic or it terminates as either the parameter p or the 
limit cycles in the family become unbounded; or the family terminates at a 
critical point or on a graphic of (1). 


We see that, except for the possible occurrence of cyclic families, this 
planar termination principle for general analytic systems is exactly the 
same as the termination principle for analytic families of rotated vector 
fields given by Theorem 6 in Section 4.6. Some results on the termination 
of the various family branches of periodic orbits of nonanalytic systems (1) 
have recently been given by Alligood, Mallet-Paret and Yorke [1]. Their 
results extend Wintner’s Principle of Natural Termination to C!-systems 
provided that we include the possibility of a family terminating as the 
“virtual periods” become unbounded. 


PROBLEM SET 7 


1. Show that the system in Example 1 experiences a subcritical Hopf 
bifurcation at the origin at the bifurcation values » = +1. 


2. Show that the system in Example 3 experiences a Hopf bifurcation 
at the origin at the bifurcation value p = —1. 


3. Draw the bifurcation diagram and describe the various bifurcations 
that take place in the system 


= —y + 2[(r? — 2)? + p? — 1][r? + Qu? — 2] 
g=atyl(r? — 2)? + pw? — Ilr? + Qn? — 2]. 


Describe the termination of all of the noncyclic, maximal, one-para- 
meter families of limit cycles of this system. 


4. Same as Problem 3 for the system 
& = —y + a[(r? — 2)? + p? — 1[r? + p? — 3] 
y=aotyl(r? — 2)? +p? — Ilr? +p? - 3]. 
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4.8 Homoclinic Bifurcations 


In Section 4.6, we saw that a separatrix cycle or homoclinic loop of a planar 
family of rotated vector fields 


x = f(x, 2) (1) 


generates a limit cycle as the parameter yp is varied in a certain sense, i.e., 
as the vector field f is rotated in a suitable sense, described by the table in 
Figure 1 in Section 4.6. In this section, we first of all consider homoclinic 
loop bifurcations for general planar vector fields 


x = f(x) (2) 


and then we look at some of the very interesting phenomena that result in 
higher dimensional systems when the Poincaré map has a transverse homo- 
clinic orbit. Transverse homoclinic orbits for the higher dimensional system 
(2) with n > 3 typically result from a tangential homoclinic bifurcation. 
These concepts are defined later in this section. 

Even when the planar system (2) does not define a family of rotated 
vector fields, we still have a result regarding the bifurcation of limit cycles 
from a separatrix cycle similar to Theorem 3 in Section 4.6. We assume 
that (2) is a planar analytic system which has a separatrix cycle So at 
a topological saddle x9. The separatrix cycle So is said to be a simple 
separatriz cycle if the quantity 


090 = V -f (x0) #0. 


Otherwise, it is called a multiple separatriz cycle. A separatrix cycle Spo is 
called stable or unstable if the displacement function d(s) satisfies d(s) < 0 
or d(s) > O respectively for all s in some neighborhood of s = 0 where 
d(s) is defined; i.e., So is stable (or unstable) if all of the trajectories in 
some inner or outer neighborhood of Sg approach Sp as t — oo (or as 
t — —oo). The following theorem is proved using the displacement function 
as in Section 3.4 of Chapter 3; cf. [A-II], p. 304. 


Theorem 1. Let xo be a topological saddle of the planar analytic system 
(2) and let Spo be a simple separatriz cycle at xo. Then So is stable iff 
Jo < 0. 


The following theorem, analogous to Theorem 1 in Section 4.5, is proved 
on pp. 309-312 in [A-I]]. 


Theorem 2. If So is a simple separatriz cycle at a topological saddle xo 
of the planar analytic system (2), then 


(i) there is a6 > 0 and ane > 0 such that any system e-close to (2) in 


the C'-norm has at most one limit cycle in a 5-neighborhood of So, 
Ns(So), and 
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(ii) for any 6 > 0 and e > 0, there is an analytic system which is e- 
close to (2) in the C!-norm and has exactly one simple limit cycle in 


N¢(So). 


Furthermore, if such a limit cycle exists, it ts of the same stability as So; 
t.e., it is stable if a9 < 0 and unstable if ao > 0. 


Remark 1. If So is a multiple separatrix cycle of (2), i.e., if a9 = 0, then 
it is shown on p. 319 in [A-TI]] that for all 6 > 0 and € > 0, there is an 
analytic system which is €-close to (2) in the C'-norm which has at least 
two limit cycles in Ng(So). 


Example 1. The system 
z=y 
y=ota?—szytpy 


defines a semicomplete family of rotated vector fields with parameter pu € 
R. The Jacobian is 


0 1 
Diz.) = ee ea? 


There is a saddle at the origin with o9 = p. There is a node or focus 
at (—1,0) and trace Df(—1,0) = 1+ yw. Furthermore, for u = —1, if we 
translate the origin to (—1,0) and use equation (3’) in Section 4.4, we find 
o = —31/2 < 0; i-e., there is a stable focus at (—1,0) at un = —1. It therefore 
follows from Theorem 5 and the table in Figure 1 in Section 4.6 that a 
unique stable limit cycle is generated in a supercritical Hopf bifurcation at 
(—1,0) at the bifurcation value 4 = —1. According to Theorems 1 and 4 in 
Section 4.6, this limit cycle expands monotonically with increasing p until 
it intersects the saddle at the origin and forms a stable separatrix cycle So 
at a bifurcation value ~ = po. Since the separatrix cycle So is stable, it 
follows from Theorem 1 that o = po < 0. Numerical computation shows 
that uo ~ —.85. The phase portraits for this system are shown in Figure 1. 


eX cx & CX 


ps-l -I<p<yPy = > Uy 


Figure 1. The phase portraits for the system in Example 1. 


The limit cycle for 4 = —.9 and the separatrix cycle for u = po ~ —.85 are 
shown in the numerical plots in Figure 2. The bifurcation diagram for this 
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0 ey 


pe-9 p= -.85 


Figure 2. The limit cycle and the separatrix cycle for the system in Exam- 
ple 1. 


-| -.9 -g ‘0 i 


Figure 3. The bifurcation diagram for the system in Example 1. 


system is shown in Figure 3 where p denotes the maximum distance of the 
limit cycle from the critical point at (—1,0). We see that a unique stable 
limit cycle bifurcates from the simple separatrix cycle So as yz decreases 
from the bifurcation value 4 = yo. And this is consistent with the table in 
Figure 1 in Section 4.6. 


Remark 2. For planar systems, the same sort of results concerning the 
bifurcation of limit cycles from a graphic of (1) hold; an example is given 
in Problem 1. 


The next example shows how a separatrix cycle can be obtained from 
a Hamiltonian system with a homoclinic loop. A limit cycle can then be 
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made to bifurcate from the separatrix cycle by rotating the vector field in 
an appropriate sense. 


Example 2. The system 


r=y 
y=rt2 (3) 


was considered in Example 3 of Section 3.3 in Chapter 3. It is a Hamiltonian 
system with 
H 2 y2 2? 
C= a ae 
It has a homoclinic loop So at the saddle at the origin given by a motion 
on the curve 
y? = 2’ + 2277/3. 


There is a center inside So, the cycles being given by H(z,y) = C with 
C <0; cf. Figure 2 in Section 3.3 of Chapter 3. We next modify this system 
as follows: 


r= X (zr, y, a) =y- a(y? a x? a 2x°/3)(z na x?) 
y=Y(z,y,a) =2+2? +aly? — 2? — 22°/3)y. (4) 


Computing 
xX Y 
Nea Ya 


we see that inside the homoclinic loop So, where H(z, y) = C with C < 0, 
the vector field defined by (4) is rotated in the negative sense; i.e., for a > 0 
the trajectories of (4) cross the closed curves H(z,y) = C with C < 0 from 
their exterior to their interior. The critical point (—1,0) of (4) is a stable 
focus. The homoclinic loop H(z, y) = 0 is preserved and we have the phase 
portrait shown in Figure 4 below. 


= 2H(z,y)[y? + (x + x”)? ], 


Figure 4. The phase portrait of the system (4) with an unstable separatrix 
cycle Spo. 
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We now fix a at some positive value, say a = .1, and rotate the vector 
field defined by (4) as in equation (5) in Section 4.6 in order to cause a 
limit cycle to bifurcate from the separatrix cycle Sp in Figure 1. We obtain 
the one-parameter family of rotated vector fields 


z= P(z,y,u) = X(z,y,.1) cosy — Y(z,y,-1) sing 


y = Q(z,y,u) = X(z,y,-1)sing + ¥(z,y,.1) cos p. (5) 


Since the separatrix cycle So in Figure 1 is negatively oriented (with w = 
—1) and unstable on its interior (with the negative of the interior stability 
ao = —1; see the paragraph following Theorem 3 in Section 4.6), it follows 
from the table in Figure 1 in Section 4.6 that a limit cycle bifurcates from 
the separatrix cycle So as y increases from zero. The phase portraits for 
the system (5) are shown in Figure 5. The trace of the linear part of (5) at 


Cx & GX & 


u<O0 uw=0 0 <p < p* uw 2 p* 


Figure 5. The phase portraits for the system (5). 


the critical point (—1,0) is easily computed. It is given by 
T, = trace Df(—1,0, zu) = P,(—1,0, uw) + Q,(—1,0, pz) 


s 1 
=2 Sin j — J COS 2} . 


Clearly 7, = 0 at u = p* = tan~!(.1/3) ~ .033 and according to Theorem 5 
and the table in Section 4.5 there is a subcritical Hopf bifurcation at the 
critical point (—1,0) at the bifurcation value yp = p* ~ .033. Cf. Figure 5. 
Also, the limit cycle for system (5) with » = .01 is shown in Figure 6. 


We see that for planar systems, one or more limit cycles can bifurcate 
from a separatrix cycle. For analytic systems, it follows from Dulac’s Theo- 
rem in Section 3.3 of Chapter 3 that at most a finite number of limit cycles 
can bifurcate from a homoclinic loop. However, in higher dimensions, even 
in the analytic case, it is possible to have an infinite number of limit cycles 
or periodic orbits bifurcating from a homoclinic loop. This was seen to be 
the case for the Lorenz system discussed in Section 4.5. Indeed, it was the 
occurrence of a homoclinic loop, similar to that shown in Figure 7, that 
started the chain of events that led to the strange behavior encountered 
in the Lorenz system. We next give a brief discussion of transverse and 
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Figure 6. The limit cycle of the system (5) with 4 = .01 generated in a 
homoclinic loop bifurcation at p = 0. 


tangential homoclinic orbits and point out that if the Poincaré map of an 
n-dimensional system with n > 3 has a transverse homoclinic orbit, then 
we typically get the strange kind of behavior encountered in Sparrow’s nu- 
merical study of the Lorenz system; i.e., a kind of chaotic dynamics results 
when the Poincaré map has a transverse homoclinic orbit. 

In Figure 7, the one-dimensional unstable manifold of the origin inter- 
sects the two-dimensional stable manifold of the origin tangentially and 
forms a homoclinic loop, 9. Figure 8 shows a transverse heteroclinic or- 
bit, 9, where W*(xo) intersects W“(x,) transversally; i.e., at any point 
q € Io, the sum of the tangent spaces TgW*(xo) and TqgW%(x;) is equal 
to R°. It is not possible for a dynamical system defined by (2) to have 
a transverse homoclinic orbit since dim W*(x9) + dim W™“(x9) < n while 
transversality requires that dim W*(xo) + dim W“(xo) > n. 

Even though dynamical systems do not have transverse homoclinic or- 
bits, it is possible for the Poincaré map of a periodic orbit to have a trans- 
verse homoclinic orbit. And, as we shall see, this has some rather amazing 
consequences. In order to make these ideas more precise, we first give some 
basic definitions and then state the Stable Manifold Theorem for maps. In 
what follows we assume that the map P: R® — R” is a C!-diffeomorphism; 
i.e., a continuously differentiable map with a continuously differentiable in- 
verse. 
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ff -< w"(0) 


Figure 7. A tangential intersection of the unstable and stable manifolds of 
the origin which forms a homoclinic loop Ip. 


Figure 8. A transverse heteroclinic orbit 9 of a dynamical system in R°. 


Definition 1. A point x9 € R” is a hyperbolic fired point of the diffeo- 
morphism P: R”® — R” if P(xo9) = xo and DP(xo) has no eigenvalue of 
unit modulus. An orbit of amap P: R” — R” is a sequence of points {x;} 
defined by x;41 = P(x;). 

The eigenvalues and generalized eigenvectors of a linear map x — Ax are 
defined as usual; cf. Chapter 1. The stable, center and unstable subspaces 
of a linear map x — Ax, where A is a real, n x n matrix, are defined as 


E* = Span{u;, Vv; | [Aj| < 1} 
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E* = Span{u,,v; | |A;| = 1} 
E* = Span{u,,v; | |A;| > 1} 


where we are using the same notation as in Definition 1 of Section 1.9 in 
Chapter 1. In the following theorem, we assume that the diffeomorphism 
P:R” — R” has a hyperbolic fixed point which has been translated to the 
origin; cf. Theorem 1.4.2, p. 18 in [G/H] or Theorem 6.1, p. 27 in [Ru]. 


Theorem 3 (The Stable Manifold Theorem for Maps). Let P:R" > 
R"” be a C!-diffeomorphism with a hyperbolic fixed point 0 € R". Then 
there exist local stable and unstable invariant manifolds S and U of class 
C! tangent to the stable and unstable subspaces E* and E* of DP(0) and 
of the same dimension such that for allx € S and n > 0, P"(x) € S and 
P"(x) — 0 as n — o0 and for allx € U andn > 0, P~"(x) € U and 
P-"(x) ~ 0 asn— oo. 


We define the global stable and unstable manifolds 


w*(0) = UP-(s) 


n>0 


and 
w(0) = |) P*(U). 
n>0 
It can be shown that if P is a C’-diffeomorphism, then W*(0) and W*(0) 
are invariant manifolds of class C’. 

Let us now assume that the C!-diffeomorphism P: R" — R” has a 
hyperbolic fixed point (which we assume has been translated to the origin) 
whose stable and unstable manifolds intersect transversally at a point xo € 
R"; cf. Figure 9. 


Xo 


O 


Figure 9. A transverse homoclinic point xo. 
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Since W*(0) and W“(0) are invariant under P, iterates of xo, P(xo), 
P?(x9),... as well as P~!(x9), P~?(x9),... also lie in W*(0) MN W“(0). We 
see that the existence of one transverse homoclinic point for P implies the 
existence of an infinite number of homoclinic points and it can be shown 
that they are all transverse homoclinic points which accumulate at 0; i.e., 
we have a transverse homoclinic orbit of P. This leads to a “homoclinic 
tangle,” part of which is shown in Figure 10, wherein W*(0) and W“(0) 
accumulate on themselves. These ideas are discussed more thoroughly in 
Chapter 3 of [Wil. 


W400) P(x) 


Figure 10. A transverse homoclinic orbit and the associated homoclinic 
tangle. 


In a homoclinic tangle, a high enough iterate of P will lead to a horseshoe 
map as in Figure 11; cf. Figure 3.4.5, p. 318 in [Wi]. Furthermore, the 
existence of a horseshoe map results in “chaotic dynamics” as described 
below. 

In the early sixties, Stephen Smale [31] described his now-famous horse- 
shoe map and showed that it has a strange invariant set resulting in what is 
termed chaotic dynamics. We now give a brief description of (a variant of) 
the Smale horseshoe map. For more details, the reader should see Chap- 
ter 2 in [Wi] or Chapter 5 in [(G/H]. The Smale horseshoe map F: D — R? 
where D = {x € R?: 0< r < 1,0 < y < 1}; geometrically, F contracts D 
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Figure 11. An iterate of P exhibiting a horseshoe map. 


Figure 12. The Smale horseshoe map. 


in the z-direction and expands D in the y-direction; and then F folds D 
back onto itself as shown in Figure 12 where V, = F(H;) and V2 = F(H2). 
Furthermore, F is linear on the horizontal rectangles H; and Ho shown in 


Figure 12. 
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) 


CIAaAeVaae’ 
BABABaWaeart 
MaABWawaeaas 
MaABRwa@saaea 


D DN F(D) DN F(D) N F2(D) 


Figure 13. The action of F and F? on D. 


In order to begin to see the nature of the strange invariant set for F, we 
next look at F?(D). The action of F and F? on D is shown in Figure 13. 
Similarly, the action of F~! and F~? on D is shown in Figure 14; cf. pp. 77- 


83 in (Wil. 


LLL: 
a 
LLL 


O DN F-"(D) DN F-'(D) N F-2(D) 


Figure 14. The action of F~! and F~? on D. 


If we look at the sets 
A, = F7'(D)NDNF(D) 


and 
Ag = F~?(D)N F7!(D)N DN F(D) NF?(D) 


pictured in Figure 15, we can begin to get an idea of the Cantor set structure 
of the strange invariant set 


A= A) Fi(D) 
j=—-00 


of the Smale horseshoe map F. The next theorem is due to Smale; cf. [G/H], 
p. 235, [31] and [32]. 
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Figure 15. The sets A, and Ag which lead to the invariant set A for F. 


Theorem 4. The horseshoe map F has an invariant Cantor set A such 
that: 


(i) A contains a countable set of periodic orbits of F of arbitrarily long 
periods, 


(ii) A contains an uncountable set of bounded nonperiodic orbits, and 
(iii) A contains a dense orbit. 


Furthermore, any C'-diffeomorphism G which is sufficiently close to F in 
the C!-norm has an invariant Cantor set 2 such that G restricted to 2 is 
topologically equivalent to F restricted to A. 


This theorem is proved by showing that the horseshoe map F is topo- 
logically equivalent to the shift map o on bi-infinite sequences of zeros and 
ones: 


OS cy Seok sey BSys $0; 619005584 22) 


_— (iery Shinai osS 21400) Sivacas Snaees) 


with s, € {0,1} for 7 = 0,+1,+2,.... Cf. Theorems 2.1.2-2.1.4 in [Wil]. 
Also, cf. Problem 6. 

Whenever the Poincaré map of a hyperbolic periodic orbit has a trans- 
verse homoclinic point, we get the same type of chaotic dynamics exhib- 
ited by the Smale horseshoe map. This important result stated in the next 
section is known as the Smale-Birkhoff Homoclinic Theorem; cf. Theo- 
rem 5.3.5, p. 252 in [G/H]. The occurrence of transverse homoclinic points 
was first discovered by Poincaré [27] in 1890 in his studies of the three- 
body problem. Cf. [15]. Even at this early date he was well aware that very 
complicated dynamics would result from the occurrence of such points. 
In the next section, we briefly discuss Melnikov’s Method which is one of 
the few analytical tools available for determining when the Poincaré map 
of a dynamical system has tangential or transverse homoclinic points. As 
was noted earlier, in dynamical systems, transverse homoclinic points and 
the resulting chaotic dynamics typically result from tangential homoclinic 
bifurcations. 
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PROBLEM SET 8 


1. Consider the system 


(a) 


(b) 
(c) 


(d) 


(e) 


(b 


=——wwZ 


(c) 


t=y+y(r* +y’) 
y= 2 —2(r? — zy + y?) + py. 


Show that this system is symmetric under the transformation 
(x,y) — (—2x,—y) and that there is a saddle at the origin and 
foci at (+1,0) for |u| < 3. 


Show that for y # 0 this system defines a semicomplete one- 
parameter family of rotated vector fields with parameter p € R. 


Use the results in Section 4.6 to show that a unique limit cycle 
is generated in a Hopf bifurcation at each of the critical points 
(+1,0) at the bifurcation value 4» = —1 and that these limit 
cycles expand monotonically as pu increases until they intersect 
the origin and form a graphic Spo at a bifurcation value p = pr > 
—1. 

Use Theorem 3 in Section 4.6 to show that So is stable; show 
that o9 = pw and deduce that yp, < 0. (Numerical computation 
shows that py, ~ —.74.) 


Use the results in Section 4.6 to show that a unique limit cycle, 
surrounding both of the critical points (+1,0), bifurcates from 
the graphic Sp as pu increases beyond the bifurcation value p. 
Can you determine how this one-parameter family of limit cycles 
terminates? 


Show that the system 


r=y 


y=er-2° 


is a Hamiltonian system with H(z,y) = y?/2 — x?/2 + 24/4, 
determine the critical points, and sketch the phase portrait for 
this system. 


Sketch the phase portrait for the system 
z= X(z,y,a) =y — aH(z,y)(z — 2°) 
y=Y¥(z,y,a)=2-2° +aH(z,y)y 


for a > 0. Note that this system defines a negatively rotated 
vector field inside the graphic H(z, y) = 0. 


Now fix a at a positive value, say a = .1, and embed the vector 
field defined in part (b) in a one-parameter family of rotated 
vector fields as in equation (5). For what range of p will this 
system have a limit cycle i.e., determine the value of yu for which 
a limit cycle bifurcates from the graphic H(z,y) = 0 and the 
value of uz for which there is a Hopf bifurcation. 
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(d) What happens if you fix a at some negative value, say a = —.1, 
in part (c)? 


. Carry out the same program as in Problem 2 for the Hamiltonian 


system 

x= 2y 

y = 122 — 32”. 
Cf. [A-II], p. 306. 


. Find the stable, unstable and center subspaces, E*, E“ and E* for 


the linear maps L(x) = Ax where the matrix 


veel a 
wae 
(a): Ae k Hf 


(a) Show that the map 


P(z,y) = (y,z—y—y") 
is a diffeomorphism and find its inverse. 


(b) Find the fixed points and the dimensions of the stable and un- 
stable manifolds W*(x9) and W™(xo) at each of the fixed points 
Xo of P. 


. (The Bernoulli Shift Map) Consider the mapping F: [0,1] — (0, 1] 


defined by 
F(z) = 2z(mod 1). 
Show that if x € (0, 1] has the binary expansion 


[oe] 

>= 
T= .8)82°°°: = 05 

j=1 


with s; € {0,1} for j = 1,2,3,..., then F(z) = .sqs3... and forn > 0 
F"(z) = .$n+1$n42.... Show that the repeating sequences .0 and .1 
are fixed points for F’, that .01 and .10 are fixed points of F?, and that 
.001, .010 and .100 are fixed points of F. Fixed points of F” are called 
periodic orbits of F of period n. Show that F has a countable number 
of periodic orbits of arbitrarily large period. Finally, show that if 
the sequences for xz and y differ in the nth place, then |F"~}(zx) — 
F"~1(y)| > 1/2. This illustrates the sensitive dependence of the map 
F on initial conditions. 
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4.9 Melnikov’s Method 


Melnikov’s method gives us an analytic tool for establishing the existence 
of transverse homoclinic points of the Poincaré map for a periodic orbit of 
a perturbed dynamical system of the form 


x = f(x) + eg(x) (1) 


with x € R” and n > 3. It can also be used to establish the existence of 
subharmonic periodic orbits of perturbed systems of the form (1). Further- 
more, it can be used to show the existence of limit cycles and separatrix 
cycles of perturbed planar systems (1) with x € R?. This section is only 
intended as an introduction to Melnikov’s method; however, more details 
are given in the next three sections for planar systems and the examples 
contained in this section serve to point out the versatility and power of 
this method. A general theory for planar systems is developed in the next 
section and some new results on second and higher order Melnikov theory 
are given in Sections 4.11 and 4.12. The reader should consult Chapters 4 
in [G/H] and [Wil for the general theory in higher dimensions (n > 3). 

We begin with a result for periodically perturbed planar systems of the 
form 


x = f(x) + eg(x, t) (2) 


where x € R? and g is periodic of period T in t. Note that this system can 
be written as an autonomous system in R? by defining 23 = t. We assume 
that f € C'(R?) and that g € C'(R? x R). Following Guckenheimer and 
Holmes (G/H], pp. 184-188, we make the assumptions: 


(A.1) For ¢ = 0 the system (2) has a homoclinic orbit 
To: X =Yo(t), —o0o < t <0, 


at a hyperbolic saddle point xo and 


(A.2) For ¢ = 0 the system (2) has a one-parameter family of periodic 
orbits -y,(t) of period T, on the interior of [9 with Oy,(0)/da # 0; 
cf. Figure 1. 


The Melnikov function, M(to), is then defined as 


M(to) = i} eo Sig F701 86 4 (8) A B(yo(t)st + to)dt (3) 


— oo 


where the wedge product of two vectors u and v € R? is defined as uAv = 
U\ V2 — V, U2. Note that the Melnikov function M(to) is proportional to 
the derivative of the Poincaré map with respect to the parameter € in an 
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Io 


Xo 


Figure 1. The phase portrait of the system (2) under the assumptions (A.1) 
and (A.2). 


interior neighborhood of the separatrix cycle [9 (or in a neighborhood of 
a cycle); cf. equation (6) in Section 4.5. Before stating the main result, 
established by Melnikov, concerning the existence of transverse homoclinic 
points of the Poincaré map, we need the following lemma which establishes 
the existence of a periodic orbit +,(t) of (2), and hence the existence of the 
Poincaré map P,, for (2) with sufficiently small e; cf. Lemma 4.5.1, p. 186 
in (G/H]. 

Lemma 1. Under assumptions (A.1) and (A.2), for € sufficiently small, 
(2) has a unique hyperbolic periodic orbit y,(t) = xo + O(€) of period T. 
Correspondingly, the Poincaré map P, has a unique hyperbolic fixed point 
of saddle type x. = Xo + 0(€). 


Theorem 1. Under the assumptions (A.1) and (A.2), if the Melnikov func- 
tion M(to) defined by (3) has a simple zero in [0,T] then for all sufficiently 
small e # 0 the stable and unstable manifolds W*(x,.) and W“(x,) of the 
Poincaré map P, intersect transversally; i.e., P. has a transverse homo- 
clinic point. And if M(to) > 0 (or < 0) for allty then W*(x, )NW™(x,.) = 9. 


This theorem was established by Melnikov [21] in 1963. The idea of his 
proof is that M(t) is a measure of the separation of the stable and un- 
stable manifolds of the Poincaré map P,; cf. (G/H], p. 188. Theorem 1 
is an important result because it establishes the existence of a transverse 
homoclinic point for P.. As was indicated in Section 4.8, this implies the 
existence of a strange invariant set A for some iterate, F,, of P, and the 
same type of chaotic dynamics for (2) as for the Smale horseshoe map, 
according to the following theorem whose proof is outlined on p. 252 in 
[G/H] and on p. 108 in [Ru]: 


Theorem (The Smale-Birkhoff Homoclinic Theorem). Let P: 
R” — R” be a diffeomorphism such that P has a hyperbolic fixed point 
of saddle type, p, and a transverse homoclinic point q € W*(p)N W“(p). 
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e) 


Figure 2. The hyperbolic fixed point x, of the Poincaré map P, in the 
section Xo at t = 0 which is identified with the section at t = T. 


Then there exists an integer N such that F = P% has a hyperbolic compact 
invariant Cantor set A on which F is topologically equivalent to a shift map 
on bi-infinite sequences of zeros and ones. The invariant set A 


(i) contains a countable set of periodic orbits of F of arbitrarily long 
periods, 
(ii) contains an uncountable set of bounded nonperiodic orbits, and 
(iii) contains a dense orbit. 


Another important result in the Melnikov theory is contained in the next 
theorem which establishes the existence of a homoclinic point of tangency 
in W°(xe) NW™"(x-); cf. Theorem 4.5.4, p. 190 in [G/H]. 


Theorem 2. Assume that (A.1) and (A.2) hold for the system 
x = f(x) + eg(x, t, 4) (4) 


depending on a parameter p € R, that g is T-periodic int, that f € C!(R?) 
and that g € C'(R? x Rx R). If the Melnikov function M(to, ») defined 
by (3) has a quadratic zero at (to,40) € (0,T] x R, i.e., if M(to, uo) = 
gh (to, Ho) = 0, Sit (to, Ho) # 0, and eM (to, Ho) # 0, then for all suffi- 
ciently small ¢ # 0 there is a bifurcation value we = po + O(€) at which 
W*(x,) and W"(x,) intersect tangentially. 


Remark 1. If for ¢ = 0, (2) or (4) are Hamiltonian systems, i.c., if 


p= (2H dH)" 
— \ Ay’? Ox} ’ 
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then V -f = 0 and the Melnikov function has the simpler form 
oo 
M(to) = | £(r0(t)) A e(-volt)st + toe (5) 


Example 1. (Cf. [G/H], pp. 191-193.) Consider the periodically perturbed 
Duffing equation 
r=y 
y=xz—2* + e(ucost — 2.5y). 
The parameter p is the forcing amplitude. For ¢ = 0 we have a Hamiltonian 
system with Hamiltonian 
2 2 4 
re se Sea 
H(z, y) = 5 5 + re 
For € = 0 there is a saddle at the origin, centers at (41,0), and two homo- 
clinic orbits 


Tt: y*(t) = +(V2sech t, —V2sechttanht)’. 


Figure 3. The phase portrait for the system in Example 1 with e = 0. 


We will compute the Melnikov function for y~{(t); the computation for 
Yo (t) is identical. From (5) 


M(to) = [  yo(t)|ucos(t + to) — 2.5y0(t)]dt 
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[o o) 
= -Vin | sech t tanh t cos(t + to)dt 
—o0o 


[o ©) 
-s / sech? t tanh? t dt 


—09 
T\ . 10 
= /2um sech (=) sin to — 3° 


The first integral can be found by the method of residues. See Problem 4. 
We therefore have 


M(to) = V2ymsech (=) [sin 7 ts) 


where ko = 10 cosh(z/2)/(3V/27) ~ 1.88. 


EF 


Fg 


O< p<k, pth, fp >k, >0 


Figure 4. The function sin to — ko/p. 


We see in Figure 4 that if 0 < 4 < ko, M(to) has no zeros and therefore 
by Theorem 1, W°(x,)NW“(x,.) = 9; if 4 = ko then M(to) has a quadratic 
zero and by Theorem 2, there is a tangential intersection of W°(x,) and 
W“(x,) at some pe = ko + 0(e); and if up > kp > 0, M(to) has a simple 
zero and by Theorem 1, W*(x,) and W“(x,) intersect transversally. This 
is borne out by the Poincaré maps for the perturbed Duffing equation of 
this example with e = .1, computed by Udea in 1981, as shown in Figure 5 
below; cf. Figure 4.5.3 in [G/H]. 

We would not expect the nonhyperbolic structure on the interior of the 
separatrix cycle [9 to be preserved under small perturbations as in (2). 
However, under certain conditions, some of the periodic orbits +, (t) whose 
periods T, are rational multiples of the period T of the perturbation func- 
tion g, i1.e., 

ToT, 
n 


are preserved under small perturbations. We assume that f(x) is a Hamil- 
tonian vector field on R?, that there is a one-parameter family of periodic 
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Figure 5. Poincaré maps for the perturbed Duffing equation in Example 1 
with € = .1 and (a) wp = 1.1, (b) wp = 1.9, and (c) pp = 3.0. Reprinted with 
permission from Guckenheimer and Holmes (Ref. [G/H]). 
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orbits 7,(t) on the interior of the separatrix cycle Io as in Figure 1, and 
that the following assumption holds 


OTo 
mae #9 (A.3) 


where h, = H(7,(t)). 


Theorem 3. I[f in equation (2) f is a Hamiltonian vector field, then under 
assumptions (A.1)-(A.3), if the subharmonic Melnikov function 


mT 
Mmn.n(to) = i F(Ya(t)) A g(ra(t),t + to)dt (6) 


along a subharmonic periodic orbit y,(t), of period mT /n, has a simple 
zero in (0,mT] then for all sufficiently small e # 0, the system (2) has a 
subharmonic periodic orbit of period mT in an €-neighborhood of +, (t). 


Results similar to Theorems 1-3 are given for Hamiltonian systems with 
two degrees of freedom in [G/H] on pp. 212-226 and in Chapter 4 of (Wil. 

We next present some simple applications of the Melnikov theory for 
perturbed planar systems of the form 


x = f(x) + eg(x, 1) (7) 


with f € C!(R?) and g € C!(R? x R™). For simplicity, we shall assume 
that f is a Hamiltonian vector field although this is not necessary if we use 
equation (3) for the Melnikov function. Similar to Theorems 1, 2 and 3 we 
have the following results established in the next section. Cf. [6, 37, 38]. 


Theorem 4. Under the assumption (A.1), if there exists a pp € R™ such 
that the function 


M(u)= [ 7 F(vo(t)) A gl-ro(t),s)at 


satisfies 
M(uo)=0 and My,,(uo) #9, 


then for all sufficiently small ¢ # 0 there is a pp, = fy + O(e) such that the 
system (7) with 4 = ys, has a unique homoclinic orbit in an O(€) neighbor- 
hood of the homoclinic orbit 9. Furthermore, if M(tto) # 0 then for all 
sufficiently small e # 0 and |js— peo, the system (7) has no separatriz cycle 
in an O(€) neighborhood of To U {xo}. 


Theorem 5. Under the assumption (A.2), if there exists a point (p19, a0) € 
R™+! such that the function 


Ta 
M(u,0) = : £(74(t)) A g(Ya(t), Hat 
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satisfies 
M(up,00)=9 and Ma(uo, 00) £9, 


then for all sufficiently small ¢ # 0, the system (7) with w = po has a 
unique hyperbolic limit cycle in an O(€) neighborhood of the cycle ~y,, (t). 
If M(po, 0) # 0, then for sufficiently small « # 0 the system (6) with 
{4 = Uy has no cycle in an O(e) neighborhood of the cycle y,,(t). 


Remark 2. Under the assumption (A.2), it can be shown that if there 
exists a point ({49,@9) € R™*! such that 


M (Ho, O20) = Ma(Ho, a0) = 0, 


Maa (Ho; 20) 7 QO and My, (4p, 20) # 0, 


then for all sufficiently small ¢ # 0 there exists a . = fp + 0(€) such that 
the system (7) with wz = yw, has a unique limit cycle of multiplicity two in 
an 0(¢) neighborhood of the cycle -y,, (t). This result as well as Theorems 4 
and 5 are proved in the next section. 


Example 2. Consider the Lienard equation 

t= y—e(uict per? + p3r%] 

y=-z 
with yo = (1, 2, 43)?. The unperturbed system with « = 0 has a cen- 
ter at the origin with a one-parameter family of periodic orbits +,(t) = 


(acost,—asint)? of period T, = 27. It is easy to compute the Melnikov 
function for this example. 


Ta 
M(wa) =f #7a(t)) Aelra(t)s Hat 
2n 
— i a(t) [ui te(t) + u222(t) + 1323 (t)]t 


2n 
=- i [107 cos? t + w20° cos* t + 304 cos* t}dt 
0 


3 
= —27na? a + $120? , 
We see that the equation M(y, a) = 0 has a solution if and only if wip3 < 
0. It follows from Theorem 5 that if u,;u3 < O then for all sufficiently 
small ¢ # 0 the Lienard system will have a unique limit cycle which is 
approximately a circle of radius 


a= so + O(e). 


Cf. Theorem 6 in Section 3.8 of Chapter 3. 
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Example 3. Consider the perturbed Duffing equation 
r=y 
y=z—z +elay + Bry] (8) 


of Exercise 4.6.4, p. 204 in (G/H], with the parameter yp = (a, 8)?. For 
€ = 0 this is a Hamiltonian system with Hamiltonian 
2 2 4 
eae en i vi 
H(2z,y) = 77 5 + 7: 
The phase portrait for this system with ¢ = 0 is given in Figure 3. The 
graphic [g U {0} Ulf shown in Figure 3 corresponds to H(z, y) = 0; i.e., 
it is represented by motions on the curves defined by 


We compute the Melnikov function in Theorem 4 for this system using the 
fact that along trajectories of (8) dt = dz/z = dz/y. We only compute 
M(z) along the right-hand separatrix [¢; the computation along [7 is 
identical. 


min) = [ 7 (ve (t)) A g(re(t), w)at 


=| ” y2(t)[ea + Bx2(t)]at 


—co 


v2 
= 2 | zy/1— x?/2(a+ Bx*)dz 
0 


4 16 
= 30 + 15° 
We see that M(j) = 0 if and only if @ = —5a/4. Thus, according to 
Theorem 4, for all sufficiently small ¢ # 0, there isa x, = a(1, —5/4)7 +0(e) 
such that the system (8) with » = p,, i.e., with B = —5a/4+ 0(e), has 
two homoclinic orbits [¥ at the saddle at the origin in an e-neighborhood 
of '*. Also, for the vector field F = f + eg in (8), we have 


0 1 
DF(0, €, 4s) = k ka ; 


Thus, by Theorem 1 in Section 4.7, the separatrix cycles PU {0} are stable 
for 09 = €a < 0 and unstable for o9 = ca > 0. Cf. Figure 6 which shows 
the separatrix cycles of (8) for ea < 0. 


We end this section by constructing the global phase portraits for the 
system in Example 3 for small e > 0,8 > 0 and —oco < a < oo. The phase 
portraits for G < 0 can then be obtained by using the symmetry of the 
system (8) under the transformation (t, z, y,a, 8) — (—t, -z, -y, —a, —f). 
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Figure 6. The graphic of the system (8) for small e 4 0,8 = —5a/4 + O(e) 
and ea < 0. 


The case when Z = 0 is left as an exercise; cf. Problem 2. For fixed 6 > 0 
and € > 0, the system (8) defines a one-parameter family of rotated vector 
fields (mody = 0) with parameter a € R. Since the separatrix cycles 
T= U {0}, which exist for a = a* = —48/5 + 0(e) according to the results 
in Example 3, are stable on their interiors and are negatively oriented, 
it follows from Theorem 3 and the table in Figure 1 of Section 4.6 that a 
stable limit cycle is generated on the interior of each of the separatrix cycles 
[= U {0} as a decreases from a*. Also, since the graphic [+ UI; U {0}, 
shown in Figure 6, is stable on its exterior and negatively oriented, a stable 
limit cycle LZ is generated on the exterior of the graphic 'f Uz U {0} as 
a@ increases from a* according to Theorem 3 and the table in Section 4.6. 

It follows from the equations (8) that the trace at the critical points at 
(+1, 0) is given by 


trace DF(+1,0,¢, 2) = e(a + B). 


And using equation (3’) in Section 4.4, we find that for a = —8 we have 


—3r Be 


72 <9 


C= 
Thus, for a = —G the weak foci at (+1,0) are stable and they are neg- 
atively oriented. According to Theorem 5 and the table in Section 4.6, a 
unique stable limit cycle bifurcates from the critical points at (+1,0) in a 
supercritical Hopf bifurcation at the bifurcation value a = —G (where we 
have fixed 3 at some positive value). And according to Theorems 1 and 6 in 
Section 4.6, these limit cycles expand monotonically with increasing a@ until 
they intersect the saddle at the origin and form the graphic [7 UTZ U {0} 
at a= a* = —48/5 + O(e). 
We next determine the behavior at infinity and draw the global phase 
portraits for (8). According to the theory in Section 3.10 of Chapter 3, the 
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critical points at infinity are at (0,+1,0) and +(G,1,0)/\/1 + 62. Accord- 
ing to Theorern 2 in Section 3.10 of Chapter 3, the behavior at these critical 
points is determined by the system 


+a¢ = 272? — 214 azz? + Br? — 24 
+3 = 2° — 23z +023 + Barz. 


The flow on the equator of the Poincaré sphere determines that the minus 
sign should be used in these equations. This system has two critical points 
at (0, 0) and at (6,0). According to Theorem 1 in Section 2.11 in Chapter 2, 
the critical point (G, 0) is a saddle node. The origin is a higher degree critical 
point with two zero eigenvalues. Using a Liapunov function, it can be shown 
that it is a stable node as in Figure 7 below. 


<a 


Figure 7. The behavior of the system (8) at infinity for e > 0 and 6 > 0. 


We now employ the Poincaré-Bendixson Theorem in Section 3.7 of Chap- 
ter 3 to deduce that, at least for the parameter range on a where (8) has 
a stable limit cycle D> enclosing the three critical points (0,0), (+1,0), 
there must be an unstable limit cycle L¢ on the exterior of L> which is the 
a-limit set of the two saddle separatrices shown in Figure 7. According to 
Theorem 1 and the table in Section 4.6, this unstable, negatively oriented 
limit cycle L* will contract as a increases; and similarly, the stable, neg- 
atively oriented limit cycle Lz will expand as a increases. The two limit 
cycles L> and Ly intersect in a saddle-node bifurcation at a semistable 
limit cycle at a bifurcation value a = a** > a*. We have numerically de- 
termined that a** = —k@+0(e) for some constant k = .752---. Assuming 
that no other semistable limit cycles occur as a varies in R, the global 
phase portraits for the system (8) with small ¢ > 0, any fixed G > 0 and 
a € R are shown in Figure 8. This assumption and the above-mentioned 
results concerning the behavior of the limit cycles of (8) are verified in 
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at <a<ar* 


a= a** a>a** 


Figure 8. The global phase portraits for the system (8) with @ > 0 and 
O<e<l. 
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the next section. The bifurcation diagram for the one-parameter family of 
limit cycles L, generated at the critical point (1, 0) in a supercritical Hopf 


bifurcation at a = —£ and the bifurcation diagram for the one-parameter 
family of limit cycles L, = Ly ») Y La e generated on the exterior of the 


graphic as a increases from a* are shown in Figure 9. 


p 
L, 
Li 


a:-B aa” a:a™ 


Figure 9. The bifurcation diagram for the two one-parameter families of 
limit cycles La and L, of the system (8). 


Numerical computation confirms the theoretical results described above. 
For € = .1 and @ = 1, the two stable limit cycles around the critical points 
(+1,0) for a = —.9, the separatrix cycle for a = a* ~ —.8, and the stable 
limit cycle D> for a = —.77 are shown in Figure 10. The unstable limit 
cycle Lt is also shown in each of the figures in Figure 10 for these values 
of a. 

For a > a**, there are an infinite number of bifurcation values which 
accumulate at a = a** and at which values there are trajectories connecting 
the saddle at the origin to the saddles at infinity; cf. (G/H], pp. 62-64. Let 
ag > aj > a3--- denote these bifurcation values. Then a? approaches 
a** from the right as n — oo and the phase portraits for a = a§,aj,... 
are shown in Figure 11. The serious student should determine the phase 
portraits for af,, < a < aj,n = 0,1,2,..., in which cases no saddle 
connections exist. This completes our discussion of the perturbed Duffing 
equation (8). 


PROBLEM SET 9 


1. Use Theorem 5 to show that if u3us < 0 and 0 < pips < 92/40, 
then for all sufficiently small ¢ 4 0 the Lienard equation 


& = y — [mix + gr? + psz*) 
y=-z 
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a@2-9 


aza*s-.8 


Figure 10. The limit cycles and the graphic of the system (8) with e = .1 
and 8 = 1. 
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a= a asa; 


a= Os a= &, 


Figure 11. Global phase portraits for the system (8) with 6 > 0 and 
0<e <1. 
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has exactly two limit cycles which are approximately circles of radii 


ae —3y3 + /9pu — 40u1 M5 
Sis 


. Construct the global phase portraits for the system (8) in Example 3 


when 3 = 0 and 0 < € < 1. Use the fact that for a #4 0 and 6 = 0 
the system (8) has a saddle-node at the critical points (0,+1,0) at 
infinity. This can be obtained from Figure 7 when the critical points 
at +(G,1,0)/\/1+ G2 approach the critical points at +(0,1,0) as 
{3 — 0+. How do the phase portraits in Figure 8 and in this problem 
for 8 = 0 change if € < 0 (and |e| < 1)? Hint: Use the symmetry 
(t,x, Y,€,Q, B) =? (-t, r,—-Y, —€,@, f). 


. For ¢ = 0 the system 


r=y 
y=rt2*t+eylat+ cz] 


is a Hamiltonian system which satisfies the assumptions (A.1) and 
(A.2); cf. Example 3 and Figure 2 in Section 3.3 of Chapter 3. Show 
that the homoclinic loop is given by a motion on the curve 


: 2 
To: y2 = 27 + re 


Compute the Melnikov function along [9 and use Theorem 4 to show 
that for all sufficiently small ¢ 4 0 there is an a, = 6/7 + O(€) such 
that this system has a homoclinic loop at the origin in an 0(€) neigh- 
borhood of Io. Show that there is a subcritical Hopf bifurcation at 
the critical point (—1,0) at the bifurcation value a = 1 and, assuming 
that there are no semistable limit cycles, sketch the phase portraits 
for this system for —co < @ < 00. 


. Computation of [ = | epee sech t- tanh t-coswo(t+to)dt by the Method 


of Residues: 


(a) Use integration by parts to show that 


co 
ee -w | sech t - sin wo(t + to)dt 


—oco 
and then since secht - sinwot is an odd function, it follows that 


oo 
= —wo sin woto / sech t - cos wot dt. 


—0o 
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(b) Let 2 = t+ i7, f(z) =sechz-coswoz = SSF and let C denote 
the contour shown below: 
1T 


-a ) a 
Then, by the Residue Theorem 


$ f(z)dz = 277 Res, in 2 f(z). 
c 


Since f(z) has a simple pole at z = im/2 (and no other singulari- 
ties inside or on C), show that Res,-in/2 f(z) = —icosh(wo7/2). 


(c) For the contour C given above, show that for z = ta + ir, 


[ COS Wo(+a + iT) 1 + evo™ 
9 cosh(+a + ir) 1 — e—2a 


ar <7me° ( 


which approaches zero as a — oo; and for z =t+in = —u+in, 
show that 


a-in a 
ij f(z)dz = coshwo7 / COS Wout - sech u du. 
a+in —@Qa 

(d) Finally, using the above results, show that 


—Wpo Sin Woto - 2m cosh(wo7 /2) 
1 + cosh wom 
= —Twpo - Sin wWoto - sech(wo7/2) 


I= 
since 1 + coshwom = 2cosh?(wo7/2). 


4.10 Global Bifurcations of Systems in R? 


Thus far in this chapter we have considered local bifurcations that occur at 
nonhyperbolic critical points and periodic orbits, and global bifurcations 
that occur at homoclinic loops and in a one-parameter family of periodic or- 
bits. According to Peixoto’s Theorem in Section 4.1, the only bifurcations 
that occur in a planar system are local bifurcations at a nonhyperbolic 
equilibrium point or limit cycle of the system, or global bifurcations that 
occur at a saddle-saddle connection or in a continuous band of cycles such 
as those surrounding a center of the system. Local bifurcations are well un- 
derstood, and the theory has been developed earlier in this chapter. Global 
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bifurcations are more difficult to understand; however, Melnikov’s method 
gives us an excellent tool for studying global bifurcations that occur at 
homoclinic (or heteroclinic) loops or in a one-parameter family of periodic 
orbits of a perturbed dynamical system. In this section, we establish the 
first-order Melnikov theory for perturbed planar analytic systems of the 
form 


x = f(x) + eg(x, €, 42) (1,.) 


with x € R? and pz € R”, presented in the previous section, and give 
some additional examples of this theory. The Melnikov theory gives us an 
excellent tool for determining the parameter values for which a limit cycle 
bifurcates from a homoclinic (or heteroclinic) loop and for determining the 
number of limit cycles in a continuous band of cycles that are preserved 
under perturbation. In fact, the number, positions, and multiplicities of 
the limit cycles of (1,) for small ¢ 4 0 are determined by the number, 
positions, and multiplicities of the zeros of the Melnikov function for (1,). 
If the Melnikov function is identically equal to zero across the continuous 
band of cycles, then a higher order analysis is necessary. This is presented 
in the next two sections. 

We begin with a proof of the most basic result of the Melnikov theory 
for perturbed planar systems, Theorem 5 in the previous section. In order 
to give a proof of that theorem based on the Implicit Function Theorem, 
it is first necessary to determine the relationship between the displacement 
function and the Melnikov function in a neighborhood of a periodic orbit 
of (1,,). The relationship is determined by integrating the first variation of 
(1,,) with respect to ¢ along the periodic orbit. The details can be found 
in [7] or in the proof of Lemma 1.1 in [37]. Before giving that result, let 
us restate the assumptions (A.1) and (A.2) in the previous section for the 
system (1,,) above. For convenience in presenting the theorems and proofs 
in this section, we shall assume that the parameter a is the arc length along 
an arc normal to the one-parameter family of periodic orbits -y,(t) of (1,) 
with ¢ = 0 and that a € J, an interval of the real line. This assumption is 
not necessary as discussed in Remark 1 below. 


(A.1) For e = 0, the system (1,,) has a homoclinic orbit 
To: X= Y(t), —-oo<t<oo 


at a hyperbolic saddle point xo. 


(A.2) For e¢ = 0, the system (1,) has a one-parameter family of periodic 
orbits 


Ta: X=7,(t), O<t<To 
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of period T, with parameter a € J C R equal to the arc length along 
an arc & normal to the family [,. 


Lemma 1. Assume that (A.2) holds for alla € I. Then the displacement 
function d(a,é€,p) of the analytic system (1,), defined in Section 3.4, is 
analytic in a neighborhood of I x {0} x R™, and in that neighborhood 


—ewo M (a, 2) 


2 
fy.(0))| + Oe? 2) 


d(a,€, 4) = 


as € — 0, where wo = £1 according to whether the one-parameter family 
of periodic orbits y,(t), with a € I, is positively or negatively oriented and 
M(a, p) is the Melnikov function for (1,) given by 


Ta et 
M(a, 1) = | ew Jo VEMa 4 (4, (t)) A (Ya (t)s0, Hat, 
where Ty, is the period of y,(t) fora eé I. 


Corollary 1. Assume that (A.2) holds for alla éI. Then foraeéeTlI and 
peR™ 


de(a, 0, pp) = ——_—— M(a, js). 


Fra(0) 


And if for some ag € I and pp €E R™, M(ao, po) = 0, it follows that 


dea (Qo, 0, Ho) = av Ma (a0, Ho). 


f(y eaRO)] 


Theorem 1. Assume that (A.2) holds for alla € I. Then if there exists 
an ag EI and a po € R™ such that 


M (ao, 49) =9 and M,(a0, Mo) #9, 


it follows that for all sufficiently small e # 0, the analytic system (1,,) has 
a unique, hyperbolic, limit cycle, in an O(€) neighborhood of T',,; the limit 
cycle I’, is stable if ewoMa(a0, ftp) > 0 and unstable if ewoMa(ao, Uo) < 0. 
Furthermore, if M(ao, Mo) # 0, then for all sufficiently small e £ 0, (1y,) 
has no cycle in an O(€) neighborhood of Ta,. 
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Proof. Under Assumption A.2, d(a,0, 2) = 0 for all a € J and p € R™. 
Define the function 


d(a, €, Ho) 
de(a,0, fo) fore =0. 


Then F(a,¢) is analytic on an open set U C R? containing I x {0}, and 
by Corollary 1 and the above hypotheses, 


F (ao, 0) = de(ao, 0, Ho) = koM (ao, Ho) = 0 


and 
F.(a9,0) = dea(ao, 0, Ho) = koMa(ao, Ho) #0, 

where the constant ko = —wo/|f(7a,(0))|. Thus, by the Implicit Function 
Theorem, cf. [R], there is a 6 > 0 and a unique function a(e), defined and 
analytic for |e| < 6, such that a(0) = ao and F(a(e),e) = 0 for all |e| < 6. 
It then follows from the above definition of F(a,e) that for € sufficiently 
small, d(a(€),€, 49) = 0 and for sufficiently small e # 0, da(a(e),€, fo) # 0. 
Thus, for sufficiently small e # 0, there is a unique hyperbolic limit cycle 
I, of (1,) at a distance a(e) along L. Since a(€) = ag + O(e), this limit 
cycle lies in an O(€) neighborhood of the cycle [',,. The stability of I. is 
determined by the sign of da(ao,0, f49); i-e., by the sign of Ma(ao, fo), as 
was established in Section 3.4. Finally, if M(ao, 49) # 0, then by Lemma 1 
and the continuity of F(a, 2), it follows for all sufficiently small « 4 0 
and |a — ao| = (€) that d(a, €, 9) # 0; i-e., (1,,) has no cycle in an O(e) 
neighborhood of the cycle I',,. 


Remark 1. We note that it is not essential in Lemma 1 or in Theorem 1 
for a to be the arc length @ along &, but only that a be a strictly monotone 
function of @. In that case, the right-hand side of (2) must be multiplied 
by 0@/0a. Also, under the hypotheses of Theorem 1, it follows from the 
above proof that there is a unique one-parameter family of limit cycles I’, 
of (1,,,) with parameter e, which bifurcates from the cycle Ig, of (1,,) for 
€ # 0. Thus, as in Theorem 2 in Section 4.7 and the results in [25], P,. can 
be extended to a unique, maximal, one-parameter family of limit cycles 
that is either cyclic or unbounded, or which terminates at a critical point 
or on a separatrix cycle of (1,). Note that Chicone and Jacob’s example 
on p. 313 in [6] has one cyclic family and one unbounded family, and the 
examples at the end of this section have families that terminate at critical 
points and on separatrix cycles. 


The next theorem establishes the relationship between zeros of multi- 
plicity-two of the Melnikov function and the bifurcation of multiplicity-two 
limit cycles of (1,,) for ¢ # 0 as noted in Remark 2 in the previous section. 
This result also holds for higher multiplicity zeros and limit cycles as in 
Theorem 1.3 in [37]. 
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Theorem 2. Assume that (A.2) holds for alla € I. Then if there exists 
an ag EI and a ftp € R™ such that 


M (ao, Ho) = Ma(ao, Ho) — 0, Maa, Ho) 7 0, 
and 
Mu, (ao, Ho) # 0, 
it follows that for all sufficiently small € there is an analytic function p(e) = 
{yo + O(€) such that for sufficiently small e #0, the analytic system (1,,e)) 
has a unique limit cycle of multiplicity-two in an 0(€) neighborhood of the 
cycle I',,. 


Proof. Under assumption (A.2), d(a,0, 4) = 0 for alla € J and wp € R™. 
Define the function F(a, €, 4) as in the proof of Theorem 1 with yz in place 
of 49. Then F(a, €, 2) is analytic in an open set containing I x {0} x R™. 
It then follows from Lemma 1 that, under the above hypotheses, 
F(ao,0, Ho) = d.(ao,0, Ho) = koM (a0, Mo) = 0, 
Fa(ao, 0, Ho) = dea (Qo, 0, Ho) = koM.(a0, Ho) = 0, 

Foaa(ao, 0, Ho) = deaa(Qo; 0, Ho) = koMaa(ao; fo) # 0, 
and 

Fu, (ao, 0, Ho) = dep, (a0, 0, Ho) ae koMu, (ao, Ho) # 0. 
Thus, by the Weierstrass Preparation Theorem for analytic functions, The- 
orem 69 on p. 388 in [A-II], there exists a 6 > 0 such that 


F(a, €, Hs) = [(a ~ ao)? + A (é, 1) (a = ag) + A2(é, 1)|P(a,€, H), 


where A;(€é, 4s), Ao(e, ps), and ®(a, €, 4s) are analytic for |e| < 5, |a—apo| < 
5, and [us _ Ho| < 5; A, (0, Ho) = A2(0, Ho) = 0, ®(a0,0, Ho) # 0, and 
OA2/Op1(0, fo) # 0 since Fy, (a0,0, 49) # 0. It follows from the above 
equation that 


Fo.(a1, €, 4) = [2(a — ao) + Ai (€, )]®(a, €, ps) 
+ [(a — a)? + Ar(€, 4)(a@ — a9) + Ad(E, 12)]Ba(ar, €, 1) 
and 
Foa(a1,€, 4 = 20(a,€, 4) + 2[2(a — ag) + Ailé, #)|fa(@, €, 4) 
+ [(@ a ag)? T A;(p)(a ~ Qo) + A2(e, H)]®aa(a, €, js). 


Therefore, if 2(a — ao) + Ai(e,z) = 0 and (a — ag)? + Aj(e, p)(a — 
Qo) + Ao(e, 4) = 0, it follows from the above equations that (1,,) has a 
multiplicity-two limit cycle. Thus, we set a = ao — A;(€,s)/2 and find 
from the first of the above equations that Fao — Aj(é, s)/2,€, 4) = 0 if 
and only if the analytic function 


Gle,u) = ZAR €,m) — Arle, m) =0 
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since by continuity ®(a,¢, 4) # 0 for small |e|, |a — ao| and |p — peo|. But 
G(0, 49) = 0 since A; (0, feo) = Ao(0, feo) = 0 and 


0G OA2 

Bu, Ho) = — Bp, Or Ho? # 0 

since F,, (a0, 0, fo) # 0. Let pp = i. isis p?). Then it follows from the 
implicit function theorem, cf. [R], that there exists a 6 > 0 and a unique 


analytic function g(€, 12,...,#m) such that g(0, po). - po) = po) and 


G(e,g(E, Ha2,-- ->Hm); H2,--+,;Pm) =0 
for |e| < 6, |u2—- po <6,..-,|Um — po < 6. For |e| < 6 we define pe(e) = 
0) 0 0 
(g(e, Hes. “®) 12, ...,n%); then, p(e) = py + O(€) and (1,,e)) has 
a unique multiplicity two limit cycle [. through the point a(eé) = ao — 
3 Ax(e, p(€)) on &; and by continuity with respect to initial conditions and 


parameters, it follows that I’, lies in an 0(€) neighborhood of the cycle Tq, 
since A, (0, ps9) = 0. 


Remark 2. The proof of Theorem 2 actually establishes that there is an 
n-dimensional analytic surface 4; = g(€,p2,..-;Hm) through the point 
(0, #9) € R™*! on which (1,,) has a multiplicity-two limit cycle for ¢ # 0. 
On one side of this surface the system (1,,) has two hyperbolic limit cycles, 
and on the other side (1,) has no limit cycle in an O(€) neighborhood of 
Tay; i.e., the system (1,,) experiences a saddle-node bifurcation as we cross 
this surface. The side of the surface on which there are two limit cycles is 
determined by wo and the sign of My, (a0, #o)Maa(@o, Mo). Cf. [38]. 


Remark 3. If M(a0, to) = Ma(ao, Mo) = «+» = M&~ (a0, fo) = 0, but 
ME" (a, Ho) # 0 and M,, (a0, Ho) # 0, then it can be shown that for 
small « # 0 (1,,e)) has a multiplicity-k limit cycle near I'g,; however, if 


M&* (ao, fo) = 0 for all k = 0,1,2,..., then de(a,0, 9) = 0 for all ae J, 
and a higher order analysis in € is necessary in order to determine the 
number, positions, and multiplicities of the limit cycles that bifurcate from 
the continuous band of cycles of (1,,) for ¢ # 0. This type of higher order 
analysis is presented in the next two sections. 


Besides the global bifurcation of limit cycles from a continuous band of 
cycles, there is another type of global bifurcation that occurs in planar sys- 
tems, namely, the bifurcation of limit cycles from a separatrix cycle. The 
Melnikov theory for perturbed planar systems also gives us explicit infor- 
mation on this type of bifurcation; cf. Theorem 4 in the previous section. 
In order to prove Theorem 4 in Section 4.9, it is necessary to determine the 
relationship between the distance d(e, 4s) between the saddle separatrices 
of (1,) along a normal line to the homoclinic orbit yo(t) in (A.1) above at 
the point (0). This is done by integrating the first variation of (1,,) with 
respect to € along the homoclinic orbit -y9(t). The details are carried out 
in Appendix I in (38]; cf. p. 358 in [37]: 
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Lemma 2. Under assumption (A.1), the distance between the saddle sep- 

aratrices at the hyperbolic saddle point x9 along the normal line to y(t) 

at Y9(0) is analytic in a neighborhood of {0} x R™ and satisfies 

_ EwoM (ph) 
If(¥0(0))| 


as € — 0, where M(,2) is the Melnikov function for (1,) along the homo- 
clinic orbit yo(t) given by 


d(é, 4) = + O(c”) (3) 


M(p) = / © ele Vole eg (Yo(t)) A g(Yo(t), 0, )de. 


—0o 


Theorem 3. Under assumption (A.1), if there exists a 4p € R™ such that 


M(po) =0 and My, (14) #0, 


then for sufficiently small e #4 0 there is an analytic function p(e) = pty + 
O(e) such that the analytic system (1, e)) has a unique homoclinic orbit I’. 
in an O(c) neighborhood of To. Furthermore, if M(jto) # 0, then for all 
sufficiently small ¢ 4 0 and |p — pto| the system (1,,) has no separatriz 
cycle in an O(€) neighborhood of To. 


Proof. Under the hypotheses of Theorem 3, it follows from Lemma 2 that, 
for small €,d(e, yz) is an analytic function that satisfies d(0, 9) = 0 and 
d,,,(0, 4,;) # 0. It therefore follows from the Implicit Function Theorem 


that there exists 6 > 0 and a unique analytic function h(e, 41,..., Um) 
which satisfies A(O, pO, 34 pe) = po) and d(e, h(e, f2,.--; bm); fa,---s 


Um) = 0 for lel < 5,|u2 — uw” < 6,..., and Jum — p| < 6. It there- 
fore follows from the definition of the function d(e, ys) that if we define 


w(e) = (h(e, wl, ..., uh), wf, ..., 4) for Je] < 5, then pr(e) = pt + 0() 


and (1,,(<)) has a homoclinic orbit I’,. It then follows from the uniqueness 
of solutions and from the continuity of solutions with respect to initial con- 
ditions, as on pp. 109-110 of [38], that I’, is the only homoclinic orbit in 
an O(€) neighborhood of [9 for |f — feol < 6. 


The next corollary, which is Theorem 3.2 in [37], determines the side of 
the homoclinic loop bifurcation surface py, = h(é, we,..-, 4m) through the 
point (0, 9) € R™*! on which (1,,) has a unique hyperbolic limit cycle 
in an O(€) neighborhood of Io for sufficiently small ¢ 4 0. In the following 
corollary we let a9 = —sgn[V - g(xo,0, f#)]; then, under hypotheses (A.1) 
and (A.2), oo determines the stability of the separatrix cycle ['. of (1,(e)) 
in Theorem 3 on its interior and also the stability of the bifurcating limit 
cycle for small ¢ # 0. They are stable if a9 > 0 and unstable if a9 < 0. We 
note that under hypotheses (A.1) and (A.2), V-f(x9) = 0 and, in addition, 
if V - g(Xo0,0, 49) = 0, then more than one limit cycle can bifurcate from 
the homoclinic loop ’, in Theorem 3 as p varies from js(e); cf. Corollary 2 
and the example on pp. 113-114 in (38]. 
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Corollary 2. Suppose that (A.1) and (A.2) are satisfied, that the one- 
parameter family of periodic orbits I, lies on the interior of the homoclinic 
loop To, and that Ap, = py — A(e, pe,..., fm) with h defined in the proof 
of Theorem 3 above. Then for all sufficiently small ¢ # 0, |p2 — pO, er 


0 
and [Lm a“ uw, 


(a) the system (1,,) has a unique hyperbolic limit cycle in an O(€) interior 
neighborhood of To if wocoMy, (Mo) Apr > 0; 


(b) the system (1,,) has a unique separatriz cycle in an O(€) neighborhood 
of To if and only tf uw, = h(é, pe,...,-tm); and 


(c) the system (1,) has no limit cycle or separatriz cycle in an 0(€) neigh- 
borhood of To if wocoMy, (Mp) Api < 0. 


by 
111= WCE, [ps Hm) 


2 


Figure 1. If wo79M,, (ftp) > 0, then locally (1,) has a unique limit cycle 
if 4, > A(E,u2,...,4m) and no limit cycle if hy < h(€,u2,..-, 4m) for all 
sufficiently small e # 0. 


We end this section with some examples illustrating the usefulness of 
the Melnikov theory in describing global bifurcations of perturbed planar 
systems. In the first example we establish Theorem 6 in Section 3.8. 


Example 1. (Cf. [37], p. 348) Consider the perturbed harmonic oscillator 


b= —y + €(pie + poe? +--+ + pongiz’*") 


y=. 


In this example, (A.2) is satisfied with ~,(t) = (acost,asint), where the 
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parameter a € (0,00) is the distance along the z-axis. The Melnikov func- 
tion is given by 


Qn 
M(an) = [ tra(t) Me(ralt).0, nae 
Qn 
= —Q? i. (141 cos?t +--+ + Hon4102" cos?" t2 t)dt 
ry 


=: 2) 3 2 H2n+1 2n+2 2n 
= —27a [Bt + usa to + Sony ey a . 


From Theorems 1 and 2 we then obtain the following results: 


Theorem 4. For sufficiently small ¢ 4 0, the above system has at most n 
limit cycles. Furthermore, for « #0 it has exactly n hyperbolic limit cycles 
asymptotic to circles of radiir;, j = 1,...,n as € — 0 if and only if the 
nth degree equation in a? 


LE Oe 
q + ghse + +( 


2n+2\ Hent1 on 
nat) size =!) 


has n positive roots a? = r?,j =1,...,n. 
Corollary 3. For 0 < py < .3 and all sufficiently small ¢ 4 0, the system 


& = —y + e(p2 — 22° + 32°) 


=2 


has ezactly two limit cycles asymptotic to circles of radii 


r= /2/5 1+ JV1-p,/.3 


as € — 0. Moreover, there exists a p,(€) = .3+ O(€) such that for all 
sufficiently small « # 0 this system with py, = p1(€) has a limit cycle of 
multiplicity-two, asymptotic to the circle of radius r = \/2/5, as € — 0. 
Finally, for 1, > .3 and all sufficiently small e 4 0, this system has no limit 
cycles, and for 1, < 0 it has exactly one hyperbolic limit cycle asymptotic 


to the circle of radius \/2/5\/1 + 1+ |w:|/.3. 


The results of this corollary are borne out by the numerical results shown 
in Figure 2, where the ratio of the displacement function to the radial 
distance, d(r,€,;)/r, has been computed for ¢ = .1 and py, = .28, .29, .30, 
and .31. 
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Figure 2. The function d(r,¢€,,)/r for the system in Corollary 3 with 
€ =.1] and p, = .28, .29, .30, and .31. 


Example 2. (Cf. [37], p. 365.) Consider the perturbed Duffing equation 
(8) in Section 4.9, which we can write in the form of the Lienard equation 


& = y + (mir + pez*) 

y=xr-2° 
with parameter ys = (41, 442); cf. Problem 1, where it is shown that the 
parameters jz, and j2 are related to those in equation (8) in 4.9 by np; =a 
and po = 3/3. It was shown in Example 3 of Section 4.9 that the Melnikov 
function along the homoclinic loop ['f shown in Figure 3 of Section 4.9 is 
given by P j 

4 1 16 

M(p) = get 15? = gh +S be2- 


Thus, according to Theorem 3 above, there is an analytic function 


B(e) = (1 -3) + 0(€) 


such that for all sufficiently small e 4 0 the above system with yz = pe(e) has 
a homoclinic orbit Tf at the saddle at the origin in an 0(e) neighborhood 
of Tg. We now turn to the more delicate question of the exact number and 
positions of the limit cycles that bifurcate from the one-parameter family of 
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periodic orbits +, (t) for e # 0. First, the one-parameter family of periodic 
orbits 7, (t) = (ra(t), ya(t))? can be expressed in terms of elliptic functions 
(cf. [G/H], p. 198 and Problem 4 below) as 


for 0 < t < Tq, where the period T, = 2K(a)V2 — a? and the parameter 
a € (0,1); K(qa) is the complete elliptic integral of the first kind. The 
parameter a is related to the distance along the z-axis by 


2 2(r? — 1) 
) 2 


and we note that 
Ox V2a 


ba (2 — a2)3/2 > 0 


for a € (0,1) or, equivalently, for x € (1, /2). For e = 0, the above system 
is Hamiltonian, i.e., V -f(x) = 0. The Melnikov function along the periodic 
orbit +,,(¢) therefore is given by 


Ta 
M (a, 4) = : £(¥_(t)) A g(¥q(t), 0, 2) dé 


Ta 
= [at (t) + (an = nao (t) - mn22 (0) at 


Then, substituting the above formula for r,(t) and letting u = t/V2 — a?, 
we find that 


1 s4K(a) 9 3 9 2 
M (qa, 2) = a 2 (5 = =) dn®°u + (141 — 2) (55) dn*u 


2 
— fy (53) anu] V2 —-—a? du 


= ana | [4uedn°u + 2(41 — u2)(2 — a*)dn*u 


— (2 — a?)?dn?uldu. 
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Using the formulas for the integrals of even powers of dn(u) on p. 194 of 
[40], 


4K(a) 
i dn?udu = 4E(a), 
0 


4K(a) 4 
i dn‘udu = =[(a? ~ 1)K(a) + 2(2 - a?) E(a)), 
0 
and 
4K(a) 4 
/ dn®udu = —[4(2 - a?)(a? — 1)K(a) + (8a* - 2307 + 23) E(a)], 

0 

where K(a) and E(q) are the complete elliptic integrals of the first and 


second kind, respectively, we find that 


4 


M(a, #) = 3 —oas7a 


{ue ~ a2)(a? — 1)K(a) 
+ (8a — 23a? + 23) E(a)] 


— 22 (2 — a?)[(a? — 1)K(a) + 22 - 0) (a) 
+ p2O= 2) 02 — 1)K(a) + 2(2 — a*) E(a)} 
— (4 — 4a? + at)E(a)| 
After some algebraic simplification, this reduces to 
Voi—— {le ~ 30? + 2)K (a) 


3(2 — a?)5/2 | 5 
— 2(a4 — a? + 1) E(a)] 


+ p[(a4* —4a? +4) E(a)—2(a* —3a?+2)K (a) } 


It therefore follows that M(a, yz) has a simple zero iff 
#1 _ 6[(at — 3a? + 2)K(a) — 2(a4 — a? + 1)E(a)| 


M2  5{(a4 — 4a? + 4) E(a) — 2(a4 — 3a? + 2)K(a))’ 


and that M(a,ms) = 0 for 0 < a < 1 iff wy = wo = O. Substituting 
a? = 2(x? — 1)/x?, the function 1/2, given above, can be plotted, using 
Mathematica, as a function of z. The result for 1 < z < V2 is given in 
Figure 3(a) and for 0 < x < 1 in Figure 3(b). We note that the monotonicity 
of the function jy; /p2 was established analytically in [37]. 


The next theorem then is an immediate consequence of Theorems 1 and 
3 above. We recall that it was shown in the previous section that for 2 > 0 
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1.1 1.2 1.3 1.4 
(a) 


0.2 0.4 0.6 0.8 


(b) 


Figure 3. The values of 2) /2 that result in a simple zero of the Melnikov 
function for the system in Example 2 for (a) 1 < z < v2 and (b) for 
0<2z<1. 


and for ¢ > 0 the system in this example has a supercritical Hopf bifur- 
cation at the critical point +(1,—e(4) + ue2)) at ui/u2 = —3. We state 
the following theorem for 2 > 0 and e > 0, although similar results hold 
for 2 < 0 and/or € < 0. We see that, even though the computation of 
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the Melnikov function M(a, yz) in this example is somewhat technical, the 
benefits are great: We determine the exact number, positions, and multi- 
plicities of the limit cycles in this problem from the zeros of the Melnikov 
function. Considering that the single most difficult problem for planar dy- 
namical systems is the determination of the number and positions of their 
limit cycles, the above-mentioned computation is indeed worthwhile. 


Theorem 5. For p2 > 0 and for all sufficiently small e > 0, the system 
in Example 2 with —3y2 < py < pi(e) = —2.4u2 + O(€) has a unique, 
hyperbolic, stable limit cycle around the critical point (1, —e(41 + p2)), 
born in a supercritical Hopf bifurcation at py, = —3p2, which expands 
monotonically as p, increases from —3p2 to p,(€) = —2.4u2 + O(e); for 
141 = py (Ee), this system has a unique homoclinic loop around the critical 
point (1, —€(441 + H2)), stable on its interior in an 0(€) neighborhood of the 
homoclinic loop '¢, defined in Section 4.9 and shown in Figure 3 of that 
section. 


Note that exactly the same statement follows from the symmetry of the 
equations in this example for the limit cycle and homoclinic loop around the 
critical point at —(1, —e(jz) + w2)). In addition, the Melnikov function for 
the one-parameter family of periodic orbits on the exterior of the separatrix 
cycle [g U {0} UI{, shown in Figure 3 of Section 4.9, can be used to 
determine the exact number and positions of the limit cycles on the exterior 
of this separatrix cycle for sufficiently small e 4 0; cf. Problem 6. 

We present one last example in this section, which also will serve as an 
excellent example for the second-order Melnikov theory presented in the 
next section. 


Example 3. (Cf. (37], p. 362.) Consider the perturbed truncated pendu- 
lum equations 


&=y + e(pr + pe22*) 
y=—rt+2° 


with parameter pe = (141, U2). For ¢ = 0, this system has a pair of hetero- 
clinic orbits connecting the saddles at (+1,0). Cf. Figure 4. 

It is not difficult to compute the Melnikov function along the heteroclinic 
orbits following what was done in Example 3 in Section 4.9. Cf. Problem 3. 


This results in 
M(p) = 2v2 (o + =). 


Thus, according to a slight variation of Theorem 3 above (cf. Remark 3.1 
in (37]), there is an analytic function 


Be) = 1 (a -) + 0(€) 


such that for all sufficiently small ¢ 4 0 the above system with pp = p(e) 
has a pair of heteroclinic orbits joining the saddles at +(1, —e(41 + p2)), 
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J 


Coy 


Figure 4. The phase portrait for the system in Example 3 with e = 0. 


i.e., a separatrix cycle, in an 0(€) neighborhood of the heteroclinic orbits 
shown in Figure 4. 

We next consider which of the cycles shown in Figure 4 are preserved 
under the above perturbation of the truncated pendulum when e # 0. 
The one-parameter family of periodic orbits yo(t) = (a(t), ya(t))? can be 
expressed in terms of elliptic functions as follows (cf. Problem 5): 


Lq(t) = _V20_ on (a= a) 
: Vv1+a? V1+a2’ 


(t) = Nee Gress a) dn (== a) 
OE eae \ Ign Vi +a?’ 
for 0 < t < Ta, where the period T, = 4K(a)/1 +a? and the parameter 


a € (0,1); once again, K(a) denotes the complete elliptic integral of the 
first kind. The parameter a is related to the distance along the z-axis by 


z= 2a” or a? = x 
~ 1+a? ~ Q— 92? 
and we note that 
Ox _ /2 


da (1 + a2)3/2 >0 


for a € (0,1) or, equivalently, for x € (0,1). For e = 0, the above system is 
Hamiltonian, i.e., V - f(x) = 0. The Melnikov function along the periodic 
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orbit +, (t) therefore is given by 
Ta 
Man) =f £ra(2) Ae (Ya(t)0, na 


Ta 
= / [ued (t) + (42 — 141)24(t) — were (t)]at. 


Then, substituting the above formula for z,(t) and letting u = t/V1 + a?, 
we get 


4K (a) 2a? 2a? \? P 
Man) = [ hs (2) = wt (iam) (7 a) sn“u 


2a2 \° 
— p2 (5) mtu V1+a?du 


1+ 


9a? 4K (a) ahs 


+ 2a?(p2 — 1)(1 + a)sn4u — 4a4posn®uldu. 


And then using the formulas for even powers of sn(u) on p. 191 of [40], 
4K(a) 4 
[ sn*udu = —5(K (a) — E(a)), 
0 a 
4K (a) 4 
[ sntudu = —((2 + a?)K(a) — 2(1+ a”) E(a)], 
0 3a4 
and 


4K (a) 
[ sn®udu = 
0 


where K(qa) and Re are the complete elliptic integrals of the first and 
second kind, respectively, we find that 


x (4a4 + 3a? + 8)K(a) — (804 + 7a? + 8) E(a)], 


M (a, 2) = Toh {Ha(l + a?)?[K(a) — E(a)| 
+ = (us — pi )(1 + a) [(2 + a”) K (a) — 2(1 + a”) E(a)] 
- = p2(40 + 307 + 8)K(a) — (804 + 7a? + 8)E(a)|} ; 


And after some algebraic simplification, this reduces to 
es 
3(1 + a2)5/2 


+ p(a? + 1)[(1 — a?) K(a) — (a? + 1)(a))} , 


M (a, #2) = {Hela — 3a? + 2)K(a) — 2(a4 — a? +1) E(a)] 
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It follows that M(a, yz) has a simple zero iff 


fi _ —6[(a4 — 30? + 2)K (a) — 2(a4 — a? + 1)E(a)] 

H2 = S(a® +.1)[(1 — a?) K(a) — (a? + 1)E(a)] 
and that M(a,yu) = 0 for 0 < a < 1 iff wy = po = 0. Substituting 
a? = x?/(2—27), the ratio 14; /p2, given above, can be plotted as a function 
of x (using Mathematica) for 0 < x < 1; cf. Figure 5. We note that the 


0.2 0.4 0.6 0.8 1 


0.6 


Figure 5. The values of 4; /j12 that result in a simple zero of the Melnikov 
function for the system in Example 3 for 0 < z < 1. 


monotonicity of the function 4; /p2 was established analytically in (37]. 


The next theorem then follows immediately from Theorems 1 and 3 in 
this section. It is easy to see that the system in this example has a Hopf 
bifurcation at the origin at 44; = 0, and using equation (3’) in Section 4.3 
it follows that for 2 < 0 and € > 0 it is a supercritical Hopf bifurcation. 
We state the following for 2 < 0 and e > 0, although similar results hold 
for f2 > 0 and/or € < 0. 


Theorem 6. For p2 < 0 and for all sufficiently small e > 0, the system in 
Example 3 with 0 < py < w(€) = —.6u2 + O(e) has a unique, hyperbolic, 
stable limit cycle around the origin, born in a supercritical Hopf bifurcation 
at p, =0, which expands monotonically as 4, increases from 0 to y1(€) = 
—.6u2 + O(e); for wi = pile), this system has a unique separatriz cycle, 
that is stable on its interior, in an O0(€) neighborhood of the two heteroclinic 
orbits y*(t) = +(tanht/V/2, (1//2) sech? t/\/2) shown in Figure 4. 


448 4. Nonlinear Systems: Bifurcation Theory 


PROBLEM SET 10 
1. Show that the perturbed Duffing oscillator, equation (8) in Section 4.9, 
r=y 
y=2—2° + e(ay + Bx7y), 
can be written in the form 
#-—eg(z,p)t -2r+2°=0 


with g(x, 4) = a+ Gz", and that this latter equation can be written 
in the form of a Lienard equation, 


&=yt+e(m2 + p22*) 


y=r-2, 


where the parameter ps = ({41, 2) = (a, 8/3). Cf. Example 2. 


2. Compute the Melnikov function M(a, yz) for the quadratically per- 
turbed harmonic oscillator in Bautin normal form, 


z= —y+ Aix — Agr? + (2QA2 + As) zy + Asy” 
y=otAy t+ rox? + (2A3 + Ag) zy — Azy?, 


with A; = oe Auge? fort = 1,...,6 and pe = (Ai,..., Ag); and show 
that M(a, 2) = 0 for all a > 0 iff Ay, = 0. Cf. [6] and [37], p. 353. 


3. Show that the system in Example 3 can be written in the form 
#-9(z,p)t+2—2° =0 


with 9(z, 2) = 4; + 3p227, and that this equation can be written in 
the form of the system 
r=y 
y= r+ 2° + cy(u1 + 3u227), 
which for ¢ = 0 is Hamiltonian with 
2 2 4 
a ae 
H =—-+—-—. 
Follow the procedure in Example 3 of the previous section in or- 


der to compute the Melnikov function along the heteroclinic orbits, 
H(z, y) = 1/4, joining the saddles at (1,0). Cf. Figure 4. 


4, Using the fact that the Jacobi elliptic function 
y(u) = dn(u, a) 
satisfies the differential equation 


y"” — (2—a*)y + 2y° = 0, 
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cf. [40], p. 25, show that the function z,(t) given in Example 2 above 
satisfies the differential equation in that example with e = 0, written 
in the form 

#-z+2°=0. 
Also, using the fact that 

dn'(u,a) = —a*sn(u,a)cn(u, a), 
cf. [4], p. 25, show that <a(t) = ya(t) for the functions given in 
Example 2. 
5. Using the fact that the Jacobi elliptic function 

y(u) = sn(u, a) 

satisfies the differential equation 
y” +(1+a7)y — 2a7y? = 0, 

cf. [40], p. 25, show that the function z,(t) given in Example 3 above 
satisfies the differential equation in that example with e¢ = 0, written 
in the form 

f+2-2°=0. 
Also, using the fact that 

sn’(u, a) = cn(u, a)dn(u, a), 

cf. [40], p. 25, show that z(t) = ya(t) for the functions given in 
Example 3. 


6. The Exterior Duffing Problem (cf. (37], p. 366): For € = 0 in the equa- 
tions in Example 2 there is also a one-parameter family of periodic 
orbits on the exterior of the separatrix cycle shown in Figure 3 of the 
previous section. It is given by 


a(t) = eV OS es (<5 a) 
ee Pat =1 \ V2a? = 1’ 
V2a t t 
walt) = Fate zen ( eaeama) dn (a), 
where the parameter a € (1//2, 1). Compute the Melnikov function 


M (a, ys) along the orbits of this family using the following formulas 
from p. 192 of {40}: 


4K(a) 4 
i cn?udu = —[E(a) - (1 - a*) K(a)] 
0 a 


4K(a) 4 
| cntudu = 3,1 [2(20° — 1)E(a) + (2 — 3a?)(1 — a?) K(a)] 
0 


ee 4 4 2 
[ cn°udu = i508 [((23a* — 23a° + 8)E(a) 


+ (1 — a?)(15at — 19a? + 8)K(a)}. 
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Graph the values of 4/2 that result in M(a, ys) = 0 and deduce 
that for 2 > 0, all small ¢ > O and yy (e) < pw < pi(e), where 
41 (€) = —2.422 + 0(e) is given in Theorem 5 and p}(e) & —2.256) + 
O(e), the system in Example 2 has exactly two hyperbolic limit cycles 
surrounding all three of its critical points, a stable limit cycle on 
the interior of an unstable limit cycle, which respectively expand and 
contract monotonically with increasing yz; until they coalesce at 4) = 
3 (€) and form a multiplicity-two, semistable limit cycle. Cf. Figure 8 
in Section 4.9. You should find that M(a, 4) = 0 if 
IT) 6[(a4 — 3a? + 2)K(a) — 2(a4 — a? +1) E(a)| 


He ~—-5((4a4 — 4a? + 1) E(a) — (a? — 1)(2a2 — 1)K(a)) 


The graph of this function (using Mathematica) is given in Figure 6, 
where the maximum value of the function shown in the figure is 
—2.256..., which occurs at a & .96. 


Figure 6. The values of jz; /z2 that result in a zero of the Melnikov function 
for the exterior Duffing problem with 1/2 < a < 1 in Problem 6. 


7. Consider the perturbed Duffing oscillator 


& = y + €(p zr + fez”) 

y a x, 
which, for ¢ = 0, has the one-parameter family of periodic orbits 
on the interior of the homoclinic loop '{, shown in Figure 3 of the 
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previous section, given in Example 2 above. Compute the Melnikov 
function M(a, ys) along the orbits of this family using the following 
formulas from p. 194 of (40): 


4K (a) 
i dn?udu = 1(2 — a’) 
0 
4K(a) T 
i dnéudu = 7(8- 8a? + 3a‘). 
0 


Graph the values of j2; /z2 that result in M(a, ys) = 0 and deduce that 
for pe > 0, all small e > 0 and —2po < py < fi (€) ¥ —1.67 p20, the 
above system has a unique, hyperbolic, stable limit cycle around the 
critical point (1, —é€(44; +42)), born in a supercritical Hopf bifurcation 
at 44) = —2pe, which expands monotonically as yp increases from 
—2p2 to ji (€) & —1.67pu2, at which value this system has a unique 
homoclinic loop around the critical point at (1, —e(1 + pe2)). 


8. Show that the system in Problem 7 can be written in the form 
r=y 
yao —2>+e(uy + 2nery), 


and then follow the procedure in Example 3 of the previous section 
to compute the Melnikov function M(,z) along the homoclinic loop 
and show that M() = 0 iff wp; = —3mp2/4V2; i.e., according to 
Theorem 3, for all sufficiently small ¢ # 0 the above system has a 
homoclinic loop at 4) = —37p2/4V2+0(e). Also, using the symmetry 
with respect to the y-axis, show that this system has a continuous 
band of cycles for 4; = 0 and draw the phase portraits for ye > 0 
and Hi < 0. 


9. Compute the Melnikov function M(a, ys) for the Lienard equation 


& = —y + (ur + pgr® + psz® + p72") 
y=, 
and show that for an appropriate choice of parameters it is possible 


to obtain three hyperbolic limit cycles or a multiplicity-three limit 
cycle for small ¢ 4 0. Hint: 


l 2n 2 1 l 2x 4 3 
=f cos tdt = 5, =f cos tdt= 5 
2n 


1 ee: ee ae ne 35 
xf cos tdt =F =f cos’ tdt = ——. 
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4.11 Second and Higher Order Melnikov Theory 


We next look at some recent developments in the second and higher order 
Melnikov theory. In particular, we present a theorem, proved in 1995 by 
Iliev [41], that gives a formula for the second-order Melnikov function for 
certain perturbed Hamiltonian systems in R?. We apply this formula to 
polynomial perturbations of the harmonic oscillator and to the perturbed 
truncated pendulum (Example 3 of the previous section). We then present 
Chicone and Jacob’s higher order analysis of the quadratically perturbed 
harmonic oscillator [6], which shows that a quadratically perturbed har- 
monic oscillator can have at most three limit cycles. Two specific examples 
of quadratically perturbed harmonic oscillators are given, one with exactly 
three hyperbolic limit cycles and another with a multiplicity-three limit 
cycle. 

Recall that, according to Lemma 1 in the previous section, under As- 
sumption (A.2) in that section, the displacement function d(a, €, 4s) of the 
analytic system (1,,) is analytic in a neighborhood of J x {0} x R™, where J 
is an interval of the real axis. Since, under Assumption (A.2), d(a,0, ps) =0 
for alla € J and wp € R”, it follows that there exists an €9 > 0 such that 
for all |e] < €9, aE J, and py € R™, 


2 
€ 
= ed, (a, p) + €7do(a, mh) +--°. 


As in the corollary to Lemma 1 in the previous section, d)(a, ys) is propor- 
tional to the first-order Melnikov function M(a, 4), which we shall denote 
by M,(qa, 4s) in this section and which is given by equation (2) in the last 
section. The next theorem, proved by Iliev in [41] using Frangoise’s re- 
cursive algorithm for computing the higher order Melnikov functions [55], 
described in the next section, gives us a formula for do(a, ss), i.e., for the 
second-order Melnikov function Mo(q, ys) in terms of certain integrals along 
the periodic orbits [, in Assumption (A.2) of the previous section. Iliev’s 
Theorem applies to perturbed planar Hamiltonian (or Newtonian) systems 
of the form 

t=ytef(z,y,€, 4) (1,,) 

y = U'(z) + €9(z,y,€, 4), 7 
where U(z) is a polynomial of degree two or more, and f and g are analytic 
functions. We note that for « = 0 the system (1,) is a Hamiltonian (or 
Newtonian) system with 


2 
H(2,y) = 5 - U(2). 


Before stating Iliev’s Theorem, we restate Assumption (A.2) in the previ- 
ous section with the energy h = H(z,y) along the periodic orbit as the 
parameter: 
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(A.2’) For ¢ = 0, the Hamiltonian system (1,) has a one-parameter 
family of periodic orbits 
Tn: x= ¥,(t), 0<t<Th, 
of period 7), with parameter h € I C R equal to the total energy 
along the orbit, i.e., h = H(-y,(0)). 


Theorem 1 (Iliev). Under Assumption (A.2’), if M,(h, 2) = 0 for all 
hel and we R”, then the displacement function for the analytic system 


(1,,) 
-_ €? Ma(h, I) 
ah eH) = EO) 


as € — 0, where the second-order Melnikov function is given by 


M2(h, L) = f [Gy,(z, y) pt) Po(z, h, Lt) - G\ (z, Yy, js) Pop, (2, h, js) |dx 


+ 0(e?) (2) 


-4 FE tt f(2,¥,0,H) + gy(z,y, 0, 2) |dx 


+ f [9e (z, y, 0, ps)dx = f.(z, y, 0, js) dy), 
h 
where 
y x 
Faun) = | s(2,s,0,n)ds— | 9(s,0,0,n)ds, 
0 0 


G(z,y, 4) = g(x,y, 0, w) + Fr(z, y, 4), 


Gi(z,y, 4) denotes the odd part of G(z,y, 4) with respect to y, Galz, Yy; y 
denotes the even part of G(z,y, 2) with respect to y, Go(z,y?, pu) = 


(x,y, 44), 


OG) 1 
G L,Y, = a (2,Y; es | 
in(Z, y, Ht) By | y, H) 7 


BGs / Go(s,2h + 2U(s), p)ds, 
0 
and P2,(z,h, 2) denotes the partial of Po(z,h, 2) with respect to h. 


In view of formula (2) for the displacement function, it follows that if 
M,(h, 4) = 0 for all h € J and ww € R™, then under Assumption (A.2’), 
Theorems 1 and 2 of Section 4.10 hold with Mo(h, 4) in place of M(a, 42) 
and h in place of a in those theorems. The proofs in Section 4.10 remain 
valid as given. We therefore have a second-order Melnikov theory where the 
number, positions, and multiplicities of the limit cycles of (1,) are given by 
the number, positions, and multiplicities of the zeros of the second-order 
Melnikov function Mo(h, 4s) of (1,,). This idea is generalized to higher order 
in the following theorem, which also applies to the general system (1,,) in 
Section 4.10 under Assumption (A.2); cf. Theorem 2.1 in [37]. 
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Theorem 2. Under Assumption (A.2), suppose that there erists a pty € 
R™ such that for some k > 1 


d(a, 0, po) = d; (a, Ho) ee dx-1(a, Ho) =0 


for alla € I, and that there exists an ap € I such that 


Od 
d(a0, Ho) =0 and = *(a0, Ho) # 0; 


then for all sufficiently smalle # 0, the system (1,,,) has a unique hyperbolic 
limit cycle in an O(€) neighborhood of the cycle T,,. 


Remark 1. Theorem 2 in Section 4.10 also can be generalized to a higher 
order to establish the existence of a multiplicity-two limit cycle of (1,,) in 
terms of a multiplicity-two zero of Mo(a, ys) or, more generally, of d;(a, js) 
with k > 2. As in Remark 3 in Section 4.10, we also can develop a higher 
order theory for higher multiplicity limit cycles; this is done in Theorem 2.2 
in [37]. 


Our first example is a quadratically perturbed harmonic oscillator that 
has one limit cycle obtained from a second-order analysis. As you will see 
in Problem 1 and in Chicone and Jacobs’ higher order analysis presented 
below, to second order any quadratically perturbed harmonic oscillator has 
at most one limit cycle. 


Example 1. Consider the following quadratically perturbed harmonic os- 
cillator: 


z= y+a(e)z + b(e)z? + c(e)zy 
y=-2 


with a(e) = €a,+e7a9+- :-, b(e) = eb +e7bo+---, and c(e) = ec, +E7eQ+---. 
For ¢ = 0, this is a Hamiltonian system with H(z,y) = y?/2 — U(z) = 
y?/2 + 27/2; it has a one-parameter family of periodic orbits 


z,(t)= V2hcost,  yn(t) = V2hsint 


with total energy h € (0,00). Using Lemma 1 in the previous section, it is 
easy to compute the first-order Melnikov function and find that 


M,(h, 2) = 2tha,; = 0 


for all h > 0 iff a; = 0. Therefore, for a second-order analysis it is appro- 
priate to consider the system 


& = y+ e(eazx + br? + cry) 
y=-2, 
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where we let az = a, b; = 6, and c,; = c for convenience in notation. In 
using Theorem 1 above to compute the second-order Melnikov function, we 
see that 


f(z,y,€,4) =eaxr+bz? +cry, g(x, y,€,) = 0, 
F(x,y,) = br?y + cry?/2, G(x, y, 4) = 2bry + cy?/2, 
G,(z, y; pL) = 2bry, G2(z, y) L) = cy” /2, Gia(z, y; ) = 2bz/y, 


Po(z, h, p) = [ c(2h — s*)/2ds = c(h — r°/6). 


Figure 1. The function d(a,¢,4s)/a for the system in Example 1 with 
€= .01,a=c=-l1, and bd=1. 


Thus, 


M2(h, p) = f |= (ne - =) - 2bex"y| da 


2 2 
Tr y Tr 


Then, using dz = ydt and dy = zrdt from the differential equations and the 
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above formulas for r,(t) and y,(t), we find that 


2n bec 2r 
Mo(h, pt) = 2beh | x} (t)dt — 3 [ zp (t)dt 
0 0 


2n 2r 
— 4bc | x} (t)y?(t)dt +a | x} (t)dt 
0 0 


bc 
= 2th (« _ zh) ; 


Thus, Mo(h, w) = 0 if h = 2a/bc. And since h = a? /2, where a is the radial 
distance, we see that for sufficiently small ¢ 4 0 the above system has a 
limit cycle through the point a = 2,/a/bc + 0(€) on the z-axis iff abc > 0. 
For € = .01, a= c= —1, and b = 1, Figure 1 shows a plot of d(a,e, u)/a 
for the above system and we see that a limit cycle occurs at a = 2 + O(e), 
as predicted. 


Example 2. We next consider the perturbed truncated pendulum in Ex- 
ample 3 of the previous section. From the computation of the first-order 
Melnikov function in that example, we see that M,(h, w) = 0 iff uw) = po = 
0. For a second-order analysis we therefore consider the system 


z= y+ e(eazr + br? + cry) 
y = —2+2°, 


where we have taken px, = €a and pe = 0 in the system in Example 3 of the 
previous section, and we sce that M,(h, uz) = 0 for the above system. As 
was noted in the previous section, for € = 0 there is a one-parameter family 
of periodic orbits r,(t), ya(t) with parameter a € (0,1) that is related to 
the distance along the z-axis by z? = 2a7/(1+ a?) and is related to the 
total energy by h = a?/(1 + a”). This is obtained by substituting the 
functions rq(t) and yqa(t), given in the previous section in terms of elliptic 
functions, into the Hamiltonian 


2 x2 xr y? 
H(z,y) =F 4+ 5 -[ => - Ue) 


for the above system with e = 0. Let us now use Theorem 1 above to 
compute the second-order Melnikov function for this system. We have 


f(z,y,€,) =ear+br?+cry, g(z,y,€, 4) = 0, 
F(z,y,@) = bx?y+cry?/2, G(z,y,m) = 2bry + cy?/2, 
Gi (z,y, w) = bry, Go(z,y, uw) = cy?/2, Gip(z,y, w) = 2bzr/y, 


Po(z,h, p) = a c(2h — s? + s4/2)/2ds = c(hz — x°/6 + x°/20), 
0 
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and P2;,(z,h,) = cz. Thus it follows from Theorem 1 that 


hz 4 76 
Ma(h, = 2e (= - E+ Fe -2Pv) ae 
2(h, 42) a y 6y  20y y 


- abe f z*ydzr — ag xdy. 
T, T, 


We then use dx = ydt and dy = (—x + r°)dt from the above differential 
equations and substitute the formulas for r,(¢) and y(t) from Example 3 
in the previous section, u = t/V/1+a2, and h = a?/(1 + a7)? into the 


above formula to get 
2 2 4K(a) 
Mo(a, 2) = 2bc zi 


a 
(1 + a2)? V1+a? Jo 


1 Ane 4K(a) 
5 ean ff sn°udu 


8a® 4K(a) 
+ ———~—,, sn®udu 
20(1 + a2)5/2 0 


dot 4K(a) 4K(a) 
[ sn?udu — (1+ a”) [ sntudu 
0 0 


sn7?udu 


~*" Gye 


4K(a) 902 
2 6 
+a I sn wie] 0: re 


4K (a) 4K (a) 
-1(1 +a?) [ sn?udu — 2a” [ sn‘udu| , 
0 0 


where K(a) is the complete elliptic integral of the first kind and we have 
used the identities cn?u = 1— sn?u and dn*u = 1 — a*sn?u for the Jacobi 
elliptic functions. Note that dh/da > 0 for a € (0,1), and it therefore does 
not matter whether we use the energy h or @ as our parameter. Now, using 
the formulas for the integrals of sn?u, sn4u, and sn®u given in Example 3 
in the last section, we find after some simplifications that 


(1 + a”)5/2Mo(a, 1) = 2be | — 24a°[K(a) — E(a)] 


+ $(1+.0?)[(2 + a2) K (a) — 21 + a?) B(a) 
= 12 4g + 3a? + 8)K(a) — (804 + 7a? + 8)B(a))} 


+ 8a(1+a7) { (1+02)[K(a)-E(a)]- sl + a?)K(a)—2(1-+a)B(a))} ; 


It follows that Mo(a, pz) = 0 if 
a  —3[(94a4 — 42a? + 188) K (a) — (18804 + 520? + 188) E(a)) 


be 225(1 + a?)[(a? — 1)K(a) + (a? + 1)E(a)] 
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Figure 2. The values of a/bc that result in a zero of the second-order 
Melnikov function for the system in Example 2 for 0 < z < 1. 


Substituting a? = x?/(2 — x?) from Example 3 in the previous section, 
the above ratio can be plotted as a function of x (using Mathematica) for 
0<2< 1. Cf. Figure 2. 


Let us summarize our results for this example in a theorem that follows 
from Theorems 1 and 2 in the previous section (with Mo(a, yz) in place of 
M (aq, 42) in those theorems) and from the fact that for ¢ 4 0 the system in 
this example has a Hopf bifurcation at a = 0. 


Theorem 3. For bc > 0 and all sufficiently small € > 0, the system in 
Example 2 with a < 0 has exactly one hyperbolic, unstable limit cycle, and 
for0<a< a(e) = .0576bc + O(e) zt has exactly two hyperbolic limit cycles, 
a stable limit cycle on the interior of an unstable limit cycle; these two limit 
cycles respectively expand and contract with increasing a until they coalesce 
ata = a(eé) and form a multiplicity-two semistable limit cycle; there are no 
limit cycles fora > a(e). The stable limit cycle is born in a Hopf bifurcation 
at a = 0; the unstable limit cycle is born in a saddle-node bifurcation at the 
semistable limit cycle; it expands monotonically as a decreases from a(é), 
and it approaches an O(€) neighborhood of the heteroclinic orbits vet (t), 
which are defined in Theorem 6 and shown in Figure 4 of Section 4.10, as 
a decreases to —oo. 


The results of the Melnikov theory are borne out by the numerical results 
shown in Figure 3, where we have computed d(z, €, 4)/z for the system in 
Example 2 with yz = (a,b,c), b =c = 1, € = .01, and a = .06, .01, —.01, 
and —.25. 
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a=.06 .01-.01 


Figure 3. The displacement function d(z, ¢, )/z for the system of Exam- 
ple 2 with e = .01 and b=c=1. 


We next consider the quadratically perturbed harmonic oscillator 
z= —y + €[ajo(€)z + aoi(€)y + aao(e)z? + ai (e)zy + ao2(€)y?) (3) 

y = z+ €[bio(e)z + bor (e)y + bao(e)x? + bi: (e)zy + bo2(e)y’). 
Because of Bautin’s Fundamental Lemma in [2] for this system, cf. Lem- 
ma 4.1 in [6], we are able to obtain very specific results for the system (3). 


The following result proved by Chicone and Jacobs in (6] is of fundamental 
importance in the theory of limit cycles. 


Theorem 4. For all sufficiently small ¢ # 0, the quadratically perturbed 
harmonic oscillator (3) has at most three limit cycles; moreover, for suffi- 
ciently small « # 0, there exist coefficients a,;(€) and b;;(€) such that (3) 
has exactly three limit cycles. 


As in the proof of this theorem in [6], we obtain the following result from 
Bautin’s Fundamental Lemma. This result also follows from Francoise’s 
algorithm; cf. Problem 2 in Section 4.12. 
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Lemma 1. The displacement function d(z,€, A) for the quadratically per- 
turbed harmonic oscillator in the Bautin normal form 

= —y t+ Ayz— Agr? + (22 + As) zy + Agy” 

y=xrt+A yt rox? + (2A3 + Ag) zy — roy? 
with A3 = 2e, Ag = €, and A; = EXAy, + E7AGQ +--+: fori = 1,2,4,5, is given 


by 
d(z,€,A) = €d)(z,A) + e*do(z, A)+-°:, 


where 

d,(z,A) = 2rA\1 2, 

d2(z, A) = 2mAjozr — 752°, 
d3(x, A) = 27432 — 7 Asa2%, 

us 
24 
ds(z, A) = 2m Aisz——Asat?-+ = [zy ar Aaa +(Aar +5)(A21A42+A22A41)]2°, 


d,(z, A) = 2rA142 — = Asoz® + A21A41(Aa1 + 5)z°, 


and where, for 44 = —5e, 
dg(z, A) = 2mrAr6z — 7 Ass2° + pq (ar Aazdoa 
+ AZoAa1 + AgzAa1A21) 2° — apt" 
for all (z,e, A) € U x R®, where U is some open subset of R? that contains 
(0,00) x {0}. 


This lemma has the following corollaries, which give specific informa- 
tion about the number, location, and multiplicities of the limit cycles of 
quadratically perturbed harmonic oscillators. 


Corollary 1. For a > 0 and all sufficiently small e¢ # 0, the quadratic 
system 
z= —y+eaxr + e(y* + 8ry — 22”) (4) 
y= a2rteray+4ezry 
has exactly one hyperbolic limit cycle asymptotic to the circle of radius 
r=, /aase—0. 


This corollary is an immediate consequence of Theorem 2 and the above 
lemma, which implies that the displacement function for (4) is given by 


d(z,€,a) = 2me*x(a — x*) + O(e°). 

Corollary 2. For A>0, B>0, andA#B, leta=AB,b=A+B, and 

c= 1. Then for all sufficiently small e #0, the quadratic system 
z= —y+ eax + 8% bry + e(y? — 2cry — 227), 


5 
y = r+etay + 12ec(y? — x”) (5) 
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has exactly two hyperbolic limit cycles asymptotic to circles of radiir = V/A 
andr = /B ase — 0. For ab > 0 there exists ac = (b*/4a)+O0(e) such that 
for all sufficiently small e 4 0 the system (5) has a unique semistable limit 
cycle of multiplicity two, asymptotic to the circle of radius r = ,/2|a|/|d| 
ase — 0. For c > b*/4a and all sufficiently small ¢ # 0, the system (5) 
has no limit cycles. 


The proof of this corollary is an immediate consequence of Theorem 2, 
Remark 1, and the above lemma, which implies that the displacement func- 
tion for (5) is given by 


d(x, €, 2) = 2me4z(a — br? + cx*) + O(e°) 
with p = (a,b,c). 


10° e=2 c= e=1 


Figure 4. The function d(z, ¢€, y4)/z for the system (5) with e = .02,a = 1/4, 
b = 5/4, and c = 1, 25/16, and 2. 


For example, according to Corollary 2, the quadratic system (5) with a = 
1/4, b= 5/4 (i.e, A= 1/4, B = 1), and c= 1 has exactly two hyperbolic 
limit cycles asymptotic to circles of radii r = 1/2 and r = 1 ase — 0. 
Furthermore, for a = 1/4 and b = 5/4, there exists a c = (25/16) + O(e) 
such that (5) has a semistable limit cycle of multiplicity two, asymptotic to 
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the circle of radius r = ,/2/5 = .63 as e — 0; and for c > 25/16, (5) has no 
limit cycles. This is borne out by the numerical results shown in Figure 4, 
where d(z, €, 4s)/x has been computed for ¢ = .02 and c = 1, 25/16, and 2. 


Corollary 3. For distinct positive constants A, B, and C, let a = ABC, 
b= AB+AC+BC,c=A+B+C, andd=1. Then, for all sufficiently 
small e #0, the quadratic system 


z= -—y+c%ar + 8e%bry +e any +8(5) sy 224 ; 


3 (6) 
y = 2+ e®ar — 1263 —___ a(t : 2 y*)- 


has exactly three hyperbolic limit cycles asymptotic to circles of radii r = 
VA, VB, and VC ase — 0. Furthermore, for ab > 0 and c = b?/3a, there 
exists a d = (c*/3b)+0(e) such that for all sufficiently small ¢ 4 0, (6) has 
a unique limit cycle of multiplicity three, asymptotic to the circle of radius 

= 1/3]a|/|b| as e — 0. 

The proof of this corollary is an immediate consequence of Theorem 2, 
Remark 1, and the above lemma, which implies that the displacement func- 
tion for (6) is given by 


d(x, €, 2) = 2ne®x(a — bx? + cx* — dx®) + O(c”) 


with ps = (a, 5,c, d). 

For example, according to Corollary 3, the quadratic system (6) with 
a = 3/4, b = 11/4,c = 3 (ie. A = 1/2, B = 1, C = 3/2), andd=1 
has exactly three hyperbolic limit cycles asymptotic to circles of radii r = 
J/1/2 & .71, r = 1, and r,/3/2 & 1.2 as « — 0. This is borne out by the 
numerical result shown in Figure 5, where d(z, €, 4s)/xz has been computed 
for ¢ = .05. 

Furthermore, according to Corollary 3, for a = 3/4, c = 3, and b = 
V3ac = 3\/3/2, there exists a d = (2//3) + 0(e) such that the quadratic 
system (6) has a unique limit cycle of multiplicity three, asymptotic to the 
circle of radius r = /V/3/2 & .93 as e — 0. This is borne out by the 
numerical results in Figure 6, where d(z,¢€,s)/z has been computed for 
€ = .05. 

We note that the formulas for d,(a,A) and d2(a,A) in Lemma 1 above 
follow from the first- and second-order Melnikov functions, respectively. Cf. 
Problem 2 in Section 4.10 and Problem 1 below. However, the remaining 
formulas in Lemma 1 depend on Bautin’s Fundamental Lemma, Lemma 4.1 
in (6], for their derivation. The results of the above lemma and its corollar- 
ies are tabulated in the second row of Table 1, and we note that, according 
to Theorem 4, a sixth- or higher-order analysis will produce at most three 
limit cycles in a quadratically perturbed harmonic oscillator. The first row 
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10” 


Figure 5. The function d(z, €, 42)/z for the system (6) with e = .05, a = 3/4, 
b= 11/4, c = 3, andd=1. 


Figure 6. The function d(z, ¢, 42) /z for the system (6) with e = .05, a = 3/4, 
b = 33/2, c = 3, and d= 2/V3. 
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TABLE 4.1. The maximum number of limit cycles obtainable from a kth 
order analysis of an nth-degree polynomially perturbed harmonic oscillator. 


in Table 1 simply reflects the fact that any linear system has no limit cy- 
cles. The first two columns in Table 1 summarize some recent work by the 
author and one of his REU students, J. Hunter Tart, during the summer of 
1995; cf. Theorem 4 in Section 4.10 and Problems 4-7 below. The numbers 
in Table 1 are the maximum number of limit cycles that are possible (and 
that are obtained for some choice of coefficients) in a first-, second-, or kth- 
order analysis of a polynomially perturbed harmonic oscillator where the 
perturbation is of degree n. It would be an extremely interesting research 
project to complete some of the rows in this table; e.g., what is the max- 
imum number of limit cycles possible in a cubically perturbed harmonic 
oscillator, and what order Melnikov theory is required to produce that 
number? For a cubically perturbed harmonic oscillator, it is known that 
this number is at least 11; cf. [42]. Also, it has been known for some time 
that for a cubically perturbed harmonic oscillator with homogenous cubic 
perturbations (and no quadratic perturbations), the maximum number of 
limit cycles is 5; cf. [43]. 


Remark 2. In a private communication, I.D. Iliev informed me that, using 
Francoise’s recursive algorithm [55], he was able to show that the maximum 
number of limit cycles obtainable from a kth order analysis of an nth- 
degree polynomially perturbed harmonic oscillator is less than or equal 
to [k(n — 1)/2] where [x] denotes the greatest integer in x. This work is 
discussed in the next section. From Table 1, we see that this upper bound 
is actually achieved for k = 1 or 2 and all n > 1; and Tliev has also shown 
that it is achieved for k = 3 and all n > 1. It follows from Theorem 4 and 
Table 1 that for n = 2 this upper bound is also achieved for 1 < k < 7, 
but that for k > 6, the maximum number of limit cycles of a quadratically 
perturbed harmonic oscillator is 3. And for n = 3, Iliev has shown that this 
upper bound is achieved for 1 < k < 5, but that for k = 6, the maximum 
number of limit cycles obtainable from a 6th order analysis of a cubically 
perturbed harmonic oscillator is 5. Cf. Table 1 in Section 4.12. At this 


4.11. Second and Higher Order Melnikov Theory 465 


time, we do not know the maximum number of limit cycles possible for 
a cubically perturbed harmonic oscillator, only that it is greater than or 
equal to 11. 


PROBLEM SET 11 


1. Use Theorem 1 to show that the second-order Melnikov function for 
the quadratically perturbed harmonic oscillator in Bautin normal 
form 

Z=ytelerA:or — 22? — (2A21 + Asi zy + y’] 
y = —2 t+eleAoy — Anz? + (4+ Aqi)zy + Aay?) 


is given by Mo(h, A) = 4h(Ay2—A5,h/4) or by Mo(a, A) = 271207- 
mAs5,a4/4 since the radial distance a = V2h for the harmonic oscil- 
lator; cf. the formula for d2(a, A) = Mo(a,A)/a in Lemma 1. 


2. Use Theorem 1 to compute the second-order Melnikov function for the 
quadratically perturbed harmonic oscillator (4) in Corollary 1 above 
and compare your result with the formula for d(z,¢,a) immediately 
following Corollary 1. (Be sure to let y — —y in order to transform 
(4) into the form (1,,) to which Theorem 1 applies.) 


3. Use Lemma 1, Theorem 2 and the results cited in Remark 1 to prove 
the corollaries in this section. 


4. Use Theorem 1 to show that the second-order Melnikov function for 
the quartically perturbed harmonic oscillator 
z= y +e(cazx + bry + edr® + ex*) 
y= —z+ecr‘ 
is given by M2(a, 4) = ma*(ica® + SZ beat + 3da? +a), where a is 
the radial distance from the origin, and deduce that for sufficiently 


small e 4 0 this system can have three limit cycles for an appropriate 
choice of coefficients yz = (a, b,c, d, e). 


5. Use Theorem 1 to show that the second-order Melnikov function for 
the harmonic oscillator with a sixth-degree perturbation of the form 


t=y+e(car + ebz® + ecr® + 2°) 
y = —2z + e(Az® + Br‘ + Cz?) 


is given by 


99 189 35 
ee 10 8 6 
Mo2(a) = ma (see + 390 2% + 39 Co 


9 4 3 2 
+500 + 7 ba +a) 
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and deduce that for sufficiently small ¢ 4 0 this system can have five 
limit cycles for an appropriate choice of coefficients. 


6. Use Theorem 1 to show that the second-order Melnikov function for 
the harmonic oscillator with a 2mth degree perturbation of the form 


f=yte(eayrt+---+€anzr?"~! + 27") 


y= —r+e(Ayr°" +--+» + Amz?) 
is given by Mo(a) = 1a? Pem_1(a?) where Pom_1(a?) is a (2m—1)th 
degree polynomial in a?, i.e., Pom-1(a?) = kj Aja*"~?2 + --- +a, 
for some constant k,; # 0. Then use Theorem 2 and Descarte’s law 
of signs to deduce that for sufficiently small ¢ 4 0, this system has 


2m—1 limit cycles for an appropriate choice of coefficients a,,...,Qm, 
A,,..., Am. 


7. Use Theorem 1 to show that the second order Melnikov function for 
the cubically perturbed harmonic oscillator 


r=y 
y=—r+e(at+br+zy+cr? + 3r7y — y°) 


is given by Mo(h) = th(2a+3bh+3ch”) and hence (since M,(h) = 0), 
this system can have two limit cycles. 


4.12 Francoise’s Algorithm for Higher Order 
Melnikov Functions 


In this section we describe J. P. Francoise’s algorithm [55] for determining 
the first nonzero Melnikov function for a perturbed Hamiltonian system of 
the form 


z= H,(z,y) + ef (z,y,€) 
y= —H,(z, y) + €9(z, y,€) (1) 


where f and g are nth-degree polynomials in z and y and analytic in e. 
It is assumed that the unperturbed system, (1) with ¢ = 0, satisfies the 
assumption (A.2’) in Section 4.11: 


(A.2’) For e = 0 the Hamiltonian system (1) has a one-parameter fam- 
ily of periodic orbits 


Ty:x=7,(t), O<t<Th 


of period T;, with parameter h € I C R equal to the total energy 
along the orbit; i.e., h = H(+,(0)). 
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Remark 1. It follows from Lemma 1 and Remark 1 in Section 4.10 for 
k = 1, from Theorem 1 in Section 4.11 for k = 2, or from Theorem 2.2 in 
[37] for general k > 1, that if we regard the displacement function d(h, €) 
for (1) as measuring the increment in the energy along a Poincaré section 
to the Hamiltonian flow (1), as was done in [57], then the first equation in 
the previous section becomes 


d(h,€) = ed,(h) + €2do(h) +--- (2) 


where d,(h) = M,(h), the kth-order Melnikov function for the system 
(1). We shall assume that this is the case throughout this section where 
we show how to use J. P. Francoise’s algorithm to determine d;(h) when 
d\(h) =--- =dx_,(h) =0 forhe I. 

Since Francoise’s algorithm is stated in terms of differential forms, we 
first make some basic remarks about differential one-forms. The student 
is already familiar with the idea of the total differential of a function. For 
example, the total differential of the second-degree polynomial Q(z,y) = 
x? + 2ry —3y? —r+y-—10 is given by dQ = (22 +2y—1)dzr+(2z—6y+1)dy. 
This total differential or exact differential is also called a polynomial one- 
form (of degree 1); however, not every polynomial one-form is an exact 
differential. But any polynomial one-form of degree n can be written 
as 

Q= > a;j;z'y dz + > b; ;2'y? dy. (3) 


it+jcn i+jgn 


Given a polynomial Hamiltonian function H(z, y), it is of fundamental 
importance in applying Francoise’s algorithm to the system (1) to know 
when we can decompose a polynomial one-form 2 into an exact differential 
dQ and a remainder depending on H as 


Q=dQ+qdH (4) 


where Q(z,y) and q(z,y) are polynomials in z and y. Clearly, if 2 = 
dQ + qdH, then since dH = 0 on any closed curve H(z,y) = h and since 
the integral of an exact differential dQ around any closed curve is zero, it 


follows that 
| Q= i dQ + | qdH =0 
H=h H=h H=h 


for all h € J. In order to apply Francoise’s algorithm to the system (1), 
it is necessary that the converse of this statement hold; i.e., for a given 
polynomial function H(z, y) we must be able to write any polynomial one- 
form 2 which satisfies f,,_,, 2 = 0 for all h € J as 2 = dQ+qdH for some 
polynomials Q(z, y) and q(z,y). If this is the case, then we say that the 
polynomial function H(z, y) satisfies the condition (+) in Definition 1 below. 
Before stating that definition, it is instructive to consider an example. 
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Example 1. Let H(z, y) = (z?+y?)/2 and consider a polynomial one-form 
of degree two 


Q = (agox* + ay, ry + Aggy” + ayoz + ap1y + ao0)dz 
+ (boox? + bi zy + boy? + bor + boiy + boo) dy. 


Integrating 2 around the closed curve H(z,y) = h, i.e. around a closed 


T 
curve [,:-+,(t) = (vah cost, V2h sin t) of the Hamiltonian system (1) 
with ¢ = 0, we find that 


2x 
| Q = 2h (b\cos?t — ag, sin?t)dt = 27h(bi9 — ao1). 
H=h 0 


Therefore, in view of the above remarks, the polynomial one-form 2 in 
this example cannot be written in the form (4) unless bj9 = ao. And if 
bio = Qo, then it is shown in the proof of Lemma 1 below that there 
are specific polynomials Q(z, y) and q(z, y) of degrees 3 and 1 respectively 
such that 9 can be written in the form (4). In Problem 1 the student will 
see that any polynomial one-form of degree 3 or 4, as given in (3), can be 
written in the form (4) provided f,,_, 2 = 0 for all h € I, i.e., provided 
that bi9 = ao; and b)2 + 3b39 = ag; + 3ao3. And in general, we shall see 
in Lemma 1 and Problem 1 below that for any polynomial one-form 2 
of degree n, f,,_, 2 = 0 for all h € I iff [(n + 1)/2] conditions on the 
coefficients a;; and 6; are satisfied (where [xz] denotes the greatest integer 
in z); and in that case 2 can be written in the form (4). 


Definition 1. The polynomial function H(z,y) is said to satisfy the 
condition (*) if for all polynomial one-forms 2, 


Q = 0 for h € I > J polynomials 
H=h 
Q(z, y) and q(z, y) such that Q = dQ + qdH. (*) 


Francoise [55] has shown that the Hamiltonian function for the harmonic 
oscillator, H(z,y) = (x? + y*)/2, satisfies the condition (*); cf. Lemma 1 
below. And Iliev [59] has shown that the Bogdanov-Takens Hamiltonian, 
H(z, y) = (x? + y*)/2 — x3/3, satisfies the condition (*); cf. Problem 3. 

Before presenting Francoise’s algorithm, we note that the system (1) can 
be written in differential form as 


(H,dz + H,dy) + e(fdy — gdx) = 0. 


And if we expand the analytic functions f and g in Taylor series about 
€=Qas 

f(z,y,€) = filz,y) + €fa(z,y) + €7fa(z,y) + °° 
and 

g(x, y,£) = g(x,y) + €go(x,y) + €793(z,y) + °°, 
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then the above differential equation can be written as 
dH — ew, — €*we — e2w3 —--- =0 (5) 


where dH = H,dz + H,dy and w, = g;dx — fjdy for j =1,2,.... 

The following theorem is J. P. Francoise’s algorithm for determining the 
kth-order Melnikov function M,(h) = d,(h) for the perturbed Hamiltonian 
system (3) modified, as in [41] or [57], to include the case when the functions 
f and g depend on «. 


Theorem 1 (Francoise). Assume that the polynomial function H(z, y) 
satisfies the condition (*). Let d(h,e) be the displacement function for 
the differential equation (5), measuring the increment in energy along a 
Poincaré section to the Hamiltonian flow. Then if d\(h) = --- = dx_-,(h) = 
0 for allh € I and for some integer k > 2, it follows that 


ax(h)= f 2, 


Q); =w,, Qn =Wm t+ > QiW; 
i+j=m 
for 2 < m < k, and the functions q;,i < 1 < k—1, are determined 
successively from the formulas ND; = dQ; + q:dH fori =1,...,k—1. 


where 


Proof. This theorem is proved by induction on k as in [55]. For k = 1, 
we begin with the classical formula of Poincaré for the first-order Melnikov 
function 


Th 
a / wien Aenele / (yn (t)) A g(a (t))dt 
H=h 0 


with f = (H,, Hz)? and g = (f1,91)7 as in Lemma 1 of Section 4.10 for 
the Hamiltonian system (1). 

For k = 2, we see that if d\(h) =0, ice. if f,,_,, 21 = 0 for all h € I, then 
it follows from the fact that H(z, y) satisfies the condition (+) that 


Q) = dQ + qdH 


for some polynomials Q, and q;. This allows us to define Ng = we + qiw}. 
And then multiplying the differential equation (5) by (1+ €q:), we find 
(1 + €q) (dH — €w, — €7wo +0 (e)] =0 
or 
dH + €(q,:dH — uy) — €?(we + qiwn) + 0 (e*) = 0 


or 
dH — edQ, — e722 + 0(e*) =0 
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as € — 0. We then integrate this last equation around a trajectory + of the 
differential equation (5) with -+y(0) = +y,,(0), using the fact that 


| dH = d(h,e) 
Y 


and that d(h,¢) = O(e?) since d,(h) = 0. This implies that Ss dQ, = O(e?) 
(which can be seen by using the mean value theorem) and that 


[io = Qe + O(e?). 
+ H=h 
This leads to 


d(h,e) — N2 + 0 (ec?) =0 
H=h 


e? da = I. 0] + 0(e*) =0 


as € — 0, which yields the desired result for d2(h). 


or 


Now let us assume that d,(h) =--- = di") = 0 for h € I where d,,(h) = 
Sian 2m for 1 < m<k—1 and where we have defined 
X=, and m=um+ D> qin; (6) 
i+j=m 


for 2 <m< k, the functions qg;,1 < i < k—1, being determined successively 
from the formulas 

Qs dQ; + qidH (7) 
for 1 <i < K—1 which follow from the assumption that d,,(h) = f H=h Stm 
= 0 for all h € J and for 1 < m < k—1 since H satisfies the condition (+). 
We then multiply the differential equation (5) by (1+ eq+---+e*~!q,_1) 
to obtain 

(1+eé€q,; +---+ e*—1q,_1) (dH a6 See epee O(e**!)] =0 

or equivalently 


dH + ¢(q,dH — w,) + €?(qodH — quw; — wo) + °°: 
+ €*")(qx_.dH — qx—20 — +++ — MWk-2 — We-1) 
— e* (wp, + quweey +--+ Qe—1W1) + O(e**?) =0 
which, according to (6) and (7), is equivalent to 
dH — (edQ, +--- t+e*~'dQg_1) — e* 2% + O(e*t!) = 0. 


Integrating this last equation around the trajectory + of (5), using the fact 
that 


i dH = d(h,e) 
Y 
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and that d(h,e) = O(e*) which implies that f/ dQ; = O(e*) for j = 
1,...,4 —1, we obtain 


d(h,e) — e* | Q% + O(e*t') =0 


ef 


as € — 0. And since 
Q, = i Q. + O(e*) 
7 H=h 
we have 


e* a) - : 0, + O(e*t+!) = 0 


as € — 0, which implies that 


d,.(h) = nee Q: 


and Theorem 1 is proved. 


We now apply Francoise’s algorithm to the polynomially perturbed har- 
monic oscillator, (1) with H(z,y) = (xz? + y?)/2. The following lemma, 
proved by I. D. Iliev in [58], not only shows that the Hamiltonian H(z, y) = 
(x? + y?) /2 satisfies the condition (*) for any polynomial one-form 2 of de- 
gree n in z and y, but it also gives the degrees of the polynomials Q and 
q in (*) in terms of n. This lemma therefore makes it possible to obtain 
an upper bound on the number of limit cycles obtainable from a kth-order 
analysis of the nth-degree polynomially perturbed harmonic oscillator (1); 
cf. Table 1 below. 


Lemma 1 (Iliev).Any polynomial one-form 2 of degree n in x and y can 
be expressed as 


Q = dQ+qdH + a(H)ydz 
where H(z, y) = (x? + y”)/2, Q(z, y) and q(z, y) are polynomials of degrees 
(n+1) and (n—1) respectively and a(h) is a polynomial of degree [S(n — 1)] 
where [x| denotes the greatest integer in x. 


Remark 2. We note that it follows from Lemma 1 and the fact that 


i dQ =0 and / qdH = 0, 
H=h H=h 


2x 
=@a =a 2 : 
[t= alh) / _ ude = a(h) i v2 (t)dt 


Thus, if f,,_, = 0 for all h € J, it follows that a(h) = 0 for all h € J 
and hence, according to Lemma 1, 2 = dQ + qdH; i.e., the Hamiltonian 
function H(z, y) = (x? + y)/2 satisfies the condition (*). 


that 
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Lemma 1 is proved by induction in [58]. We illustrate the idea of the 
proof by carrying out the first two steps in the induction proof and ask the 
student to do more in Problem 1 at the end of this section. 


Proof (for n = 1 and 2). For n = 1 we wish to show that for any given 
polynomial one-form of degree 1, 


Q = (ajoxr + any + ano)dx + (bioxr + boi y + boo) dy, 


we can find a second-degree polynomial 


Q(z,y) = Qoozr? + Qiizy + Qo2y” + Qior + Qory 
and zeroth-degree polynomials q(z, y) = goo and a(h) = ao satisfying 
Q = dQ+qdH + a(H)ydz, 
i.e., satisfying 
(aioz + aory + aoo)dx + (biz + boiy + boo)dy 


= [(2Q20 + qoo)z + (Qii + 0)y + Qioldx 
+ (Qi1z + (2Q02 + goo)y + Qoi}dy. 
This is equivalent to 2Q20 + goo = 410, Q11 + Go = 201,Q10 = 00; Q11 = 
bi9, 2Q02 + Goo = 501 and Qo1 = boo. There is one degree of freedom in 
this system of six equations in seven unknowns and we are free to choose 


goo = 0. It will also be possible to choose goo = 0 for any n > 1. We 
therefore arrive at 


b 
Q(z,y) = S22? + biozy + Sty? + aoor + boos 
q(z,y) =0 and a(h) = aq; — dio. 


For n = 2, we wish to show that for any given polynomial one-form of 
degree 2, 


Q = (agox? + ay, ry + an2y” + aior + any + aoo)dr 
+ (box? + by ry + bo2y? + bior + boiy + bo0)dy, 


we can find a third-degree polynomial 


Q(z, y) = Qaor* + Qaiz?y + Qiery? + Qosy* 
+ Qoox? + Quizy + Qo2y? + Qior + Qoiy, 


a first-degree polynomial q(x, y) = qioz + go1y, and a zeroth-degree poly- 
nomial a(h) = ao satisfying 


Q = dQ + qdH + a(H)ydz, 
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i.e., satisfying 


Q= [(3Q30 + qio)z? + (2Qa1 + go1) ry + Qi2y? 
+2Q20z + (Qii + Q0)y + Qio] dz 
+ [Qoix? + (2Q12 + q10)zy + (3Qo3 + 901) y” 
Quiz + 2Qo2y + Qo:] dy. 
This is equivalent to 3Q39 + qi0 = @20, 2Q21 + Go1 = 211, Qi2 = a02, 2Q20 = 
210; Qi + Go = 201, Q10 = 200; Qa1 = 620, 2Q12 + gio = 611, 3Q03 + 901 = 


bo2,Q1 = 610,2Qo2 = 01, and Qo; = bo. The solution of this system of 
twelve equations in twelve unknowns lead to 


l l 
Q(z, y) = 3 (220 — bi, + 2aq2)x? + bop x?y + agory” + 3 (bo2 — a4; + 2b99)y° 


1 
+ 5 A10r + biory + bor y?/2 + aoor + booy, 
q(x, y) = (b11 = 2a02)x + (a}1 = 2be0)y and a(h) =2@01 — bio. 


The student is asked to provide the proof for n = 3 and for the highest- 
degree terms for n = 4 (noting that, as above, all of the other terms remain 
the same). This will allow the student to see how the general nth step in 
the induction proof should proceed. 


Corollary 1. For H(z,y) = (x? +y*)/2, any integral f,,_, 2 of a polyno- 
mial one-form of degree n has at most [3(n —1)] isolated zeros in (0, 00). 
Proof. As in Remark 2, f,,_,2 = 0 iff a(h) = 0. And since a(h) is a 


polynomial of degree [5(n — 1)], according to Lemma 1, f,,_, 2 has at 
most [4(n— 1)] isolated zeros in (0, 00). 


The next corollary follows from Theorem 1 and Lemma 1. 
Corollary 2. If H(z, y) = (z? + y?)/2 and d\(h) = --- = dyg_,(h) = 0 for 
he I = (0,00), then 2, is a polynomial one-form of degree k(n — 1) + 1. 


Proof. The proof follows by induction on k. For k = 1, deg 2) = deg w, = 
deg (gi dz — f;dy) = n since f; and g; are polynomials of degree n in x and 
y. Then, according to Theorem 1, deg Q2 = deg (wo+qiw)) = deg (qiw) = 
(n — 1) +n since deg 2) = n implies that deg gq; = (n — 1) by Lemma 1. 
Now assuming that deg 2.1 = (k-—1)(n—1) +1, it follows from Lemma 1 
that deg qx—1 = (kK — 1)(n — 1) and then, according to Theorem 1, 


deg 2, =deg | uz + 2 qi; 
i+j=k 
= deg (qx-1¥1) = (kK -—1)(n-1)+n=k(n-1)4+1 
and this completes the proof of Corollary 2. 


474 4. Nonlinear Systems: Bifurcation Theory 


Theorem 2. Assume that H(z, y) = (x?+y*)/2 and that d,(h) is the first 
Melnikov function for (1) that does not vanish identically. Then 


d,(h) = Rae 2, 


has at most [k(n — 1)] zeros, counting their multiplicities, for h € (0,00). 


Proof. By Corollary 2, 2, is a polynomial one-form of degree k(n —1)+1 
and then by Corollary 1, d,(h) = f H=h Stk has at most [ZA(n - 1)] isolated 
zeros in (0, 00). 


This theorem, together with Theorem 2 and Remark 1 in Section 4.11, 
then allows us to estimate the number of limit cycles obtainable from a 
kth-order analysis of an nth-degree polynomially perturbed harmonic os- 
cillator. The results are displayed in Table 1 below. Cf. Table 1 at the end 
of Section 4.11. Iliev [58] has also shown that the first three columns of 
Table 1 are exact, i.e., that the maximum number of limit cycles given by 
Theorem 2 above for k = 1, 2,3 is actually obtained for some perturbation, 
and that the numbers shown in the third row are exact except that for 
n = 3 and k = 6, the exact upper bound is 5 and not 6. We also know from 
Section 4.11 that the numbers in the first two rows of Table 1 are exact. 
Furthermore, Iliev (58] has conjectured that all of the numbers written ex- 
plicitly in Table 1 are exact upper bounds except for n = 3 and k = 6, where 
the maximum number of limit cycles obtainable is 5 and not 6. The first 
row in Table 1 illustrates the fact that any linear system has no limit cycles 
and from Chicone and Jacob’s result, Theorem 4 in Section 4.11, we know 
that the second row of Table 1 stabilizes at the value 3 for all k > 6; i.e., a 
quadratically perturbed harmonic oscillator has at most 3 limit cycles and 
it takes a 6th or higher order analysis in the small parameter ¢€ to actually 
obtain 3 limit cycles. We believe that every row in Table 1 will stabilize at 
some value N(n) for all k > K(n). We know that N(1) = 0, N(2) = 3, that 
N(3) > 11, according to [42], and that K(3) > 11, according to Theorem 2. 


TABLE 4.1. The maximum number of limit cycles obtainable from a 
kth-order analysis of an nth-degree polynomially perturbed harmonic os- 
cillator. 


m-1 2%m-1 3m-2 4m-2 5m-3 6m-3 
2m 3m 4m 5m 6m 
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PROBLEM SET 12 


1. (a) Carry out the third step in the induction proof of Lemma 1, i.e., 
for n = 3 determine polynomials 


Q(z, y) = Qaoz’ + Qaiz®y + Qoor?y? + Qiszy® + Qoay* 
+ Q3oz* + Qaiz?y + Qiozy” + Qosy® + Qoor? 
+ Qiuzy + Qo2y? + Qioz + Qory, 


q(z,y) = go0z + quizy + gory? + Nox + gory and a(H(z,y)) = 
a, (xz? + y*)/2+ a9 such that for any polynomial one-form 2 of 
degree 3 we have 


Q = dQ+qdH + a(H)ydz. 


Note that all but the highest-degree terms in Q,q and a are 
exactly the same as those obtained in the proof of Lemma 1 for 
n = 2. Also, note that there are only four equations for the five 
unknowns Q40, Q22, Qo4a, 920 and go2; so there is one degree of 
freedom and we can choose go2 = 0. In particular, you should 
find that a(h) = (a2: + 3a93 — b12 — 3b39)h/2 + (ao1 — 619) and 
this implies that any polynomial one-form 2 of degree 3 satisfies 
ieee Q = 0 for all h € J iff big = ag) and b,2+3b39 = a2] +3ao3. 


(b) Carry out the fourth step in the induction proof of Lemma 1 
for the higher-degree terms not found in part (a); i.e., for n = 
4, determine the highest-degree terms in Q(z,y) = Qsoxr° + 
Qaiz*y + Qsozr%y* + Qazz*y? + Quazy’ + Qosy®, and q(z,y) = 
q30x* + qaix*y + qiery” + gosy® such that Q = dQ + qdH + 
a(H)ydz is satisfied. 


Carry out the nth step (separately for n even and for n odd) in 
the induction proof of Lemma 1 for the highest-degree terms in 


Q(z,y),4(z,y) and a(H(z, y)); cf. [58]. 


2. Consider the quadratically perturbed harmonic oscillator in the Bautin 
normal form given in Lemma 1 in Section 4.11: 


(a) Use Frangoise’s algorithm to show that if d)(h) = M,(h) = 0 
for all h > O (i.e., if A; = 0), then the second order Melnikov 
function, M2(h) or d2(h), for 


a 
oO 
wee” 


Z=yrteleror — 2x? — (2A21 + Asi)ry + y?] 

y = —z + €feAray — Anz? + (4+ Agi) zy + y?] 
is given by Mo(h) = 4h\y2 — wh?As, (as in Problem 1 in 
Section 4.11). Hint: As in the proof of Lemma 1, for 2; = 


[—Agiz? + (44+Aqi) zy t+ Aary?|dx + (2x? + (2A21 +A51) ry — y?J]dy, 
you should find that q;(z, y) = Asiz + Aary. 
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(b) If d\(h) = 0 and do(h) = 0 for all h > O (ie., if A}; = 0 and 
A12 = As; = 0), use Francoise’s algorithm to show that the third 
order Melnikov function, M3(h) or d3(h), for 


r= y + ele? Aig = 2x? = (2X21 + EAs2)xry + y?] 
y = —x + ele*Aisy — Agr? + (44+ Ag)ry + Ary?] 


is given by M3(h) = 4m2h\13 — mh?A52 (as in Lemma 1 in Sec- 
tion 4.11 where x = a = V2h and M3(h) = V2hd3(V2h, A) 
with d3(z,A) given in Lemma 1 of Section 4.11). Hint: You 
should find that q)(z,y) = Aa,y and, from Problem 1(a), that 
qo(z, y) = Asoxr — (2X41 + Na )x? = Xai (7A21 — rX4) — 4)ry/4. 


(c) Use Francoise’s algorithm to derive the formulas for d4(h),..., 
dg(h) in Lemma 1 in Section 4.11. 


3. Consider the polynomially perturbed Hamiltonian system (1) with 


H(z,y) = (x? + y*)/2 — x3/3, that was treated by Iliev in [59]. Cf. 
Problem 3 in Section 4.13. In order to gain an understanding of the 
analysis carried out in [59], which parallels the analysis in this sec- 
tion for the perturbed harmonic oscillator, the student should carry 
out the first two steps (for n = 1 and 2) in the induction proof of 
the following lemma due to Iliev [59] where a polynomial function 
p(x,y, 1) is said to have weighted degree n if 


p(z,y,H)= S>  aijexty'H*. 
t+j7+2kEn 
Lemma. For H(z,y) = (xz? + y*)/2 — 23/3, any polynomial one- 
form Q of degree n can be expressed as 


Q =dQ+qdH + a(H)ydz + B(H)rydr 
where Q(xz,y,H) and q(z,y,H) are polynomials of weighted degree 


(n +1) and (n — 1) respectively and a(h) and G(h) are polynomials 
of degrees [$(n - 1)] and [3 (n — 2)] respectively. 


Hint: In the proof of this lemma for n = 2 we have 


Q(z, y, H) = Qzor* + Qaix?y + Qrary” + Qosy® 
+ Qoox? + Qiizy + Qozy” + Qiox + Qory 
+ (Byox + Boiy)((x? + y?)/2- x° /3), 


q(xz,y,H) = qr + qoiy,a(h) = ao and G(h) = fo. Note that it is 
possible to choose Bo, = 0 and qo, = 0. 

Based on this lemma, Iliev [59] was able to prove that for k = 1 
and for k = 2 with n even, the polynomially perturbed Bogdanov- 
Takens system has at most k(n — 1) limit cycles and for k = 2 with 
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n odd or for k > 3, it has at most k(n — 1) — 1 limit cycles. This 
leads to the following table giving the maximum number of limit cy- 
cles obtainable in a kth-order analysis of an nth-degree polynomially 
perturbed Bogdanov-Takens Hamiltonian system. It is known that 
the first three columns are exact and that for n = 2 and k > 2 the 
maximum number of limit cycles is 2; cf. [59]. 


TABLE 4.2. The maximum number of limit cycles obtainable from 
a kth-order analysis of an nth-degree polynomially perturbed Bog- 
danov-Takens Hamiltonian system. 


4m-1 6m-1 


4.13 The Takens—Bogdanov Bifurcation 


In this section, we bring together several of the techniques and ideas de- 
veloped in the previous sections in order to study the Takens—-Bogdanov 
or double-zero eigenvalue bifurcation. This is the bifurcation that results 
from unfolding the normal form 

r=y 

] 

yaar? try. (1) 
In Section 2.13, we saw that this normal form is obtained from any system 
with a double zero eigenvalue of the form 


b : i + bry + cy’ 
x= x 
0 0 dr* + exy + fy’ 


) +009) 


when d # 0 and e + 2a F 0; cf. Remark 1 in Section 2.13. As was noted in 
that remark, a universal unfolding of the normal form (1) is given by 
cT=y 
Y=mitpoyta2? + cy. 
This was proved independently by Takens [44] in 1974 and Bogdanov [45] 


in 1975. Since the above system with the plus sign is transformed into 
the above system with the minus sign under the linear transformation of 
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coordinates (zx, y,t, 41,2) — (z,—y, —t, 41, —p2), it is only necessary to 
consider the above system with the plus sign, 


E=y 


dos 2 (2) 
Y= Mitpayts’+cy, 


in determining the different types of dynamical behavior that occur in 
unfoldings of (1). Cf. Problem 6. Since there are two parameters in the 
universal unfolding (2) of (1), we see that the Takens—Bogdanov bifurcation 
is a codimension-two bifurcation. 

In order to determine the various types of dynamical behavior that occur 
for the system (2), let us begin by determining the location and the nature 
of the critical points of (2). For uw; = y2 = 0 the system (2) reduces to the 
system (1), which has a nonhyperbolic critical point at the origin, and it 
follows from Theorem 3 in Section 2.11 that the system (1) has a cusp at 
the origin. For 4; > 0, the system (2) has no critical points; and for 4, = 0 
and p2 # 0, (2) has one nonhyperbolic critical point at the origin. It follows 
from Theorem 1 in Section 2.11, or from the Center Manifold Theory in 
Section 2.12, that in this case (2) has a saddle-node at the origin. Cf. 
Problem 1. Finally, for 4; < 0, the system (2) has two hyperbolic critical 


points, 
x, =(V—-41,0) and = x_ = (-V—p),0). 


Furthermore, the linear part of the vector field f in (2) at these critical 
points is determined by the matrix 


0 1 
Df a 
(rs) H2V/—-p1 pot =; 


It follows that for ~; < 0, x4 is a saddle and that x_ is a source for 


a > J/—p, and a sink for po < /—). It is a weak focus for wo = J/—-p1, 
and from equation (3’) in Section 4.4 we find that 


C= _ 3m > 0: 
[Qu (8/2 7 


i.c., X is an unstable weak focus of multiplicity one for uw; <0 and p2 = 
Vi at 

We next investigate the bifurcations that take place in the system (2). For 
}4, = 0 and po # 0, the system (2) has a single-zero eigenvalue. According 
to Theorem 1 in Section 4.2, the system (2) experiences a saddle-node 
bifurcation at points on the po-axis with po # 0; i.e., there is a family of 
saddle-node bifurcation points along the j2-axis in the y-plane: 


SN: p, = 0, He #0. 


Cf. Problem 2. Next, according to Theorem 1 in Section 4.4, it follows that 
the system (2) experiences a Hopf bifurcation at the weak focus at x_ for 
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parameter values on the semiparabola po = /—p when py < 0; i.e., for 
4, < 0, there is a curve of Hopf bifurcation points in the y-plane given by 


A: po = V—-p1 for p, < 0. 


Furthermore, since a > 0, as was noted above, it follows from Theorem 1 in 
Section 4.4 that there is a subcritical Hopf bifurcation in which an unstable 
limit cycle bifurcates from x_ as po decreases from po = /—p) for each 
p4, < 0. This fact also follows from Theorem 5 in Section 4.6, since the 
system (2) forms a semicomplete family of rotated vector fields with pa- 
rameter po € R. Furthermore, it then follows from Theorems 1, 4, and 6 in 
Section 4.6 that for all 4; < 0 the negatively oriented unstable limit cycle 
generated in the Hopf bifurcation at w2 = /—p) expands monotonically 
as jlo decreases from ,/—j until it intersects the saddle at x, and forms 
a separatrix cycle or homoclinic loop at some parameter value po = h(p21); 
i.e., there exists a homoclinic-loop bifurcation curve in the p-plane given 
by 
HL: po = h(n) for py, <0. 


It then follows from the results in (38] that h(j) is analytic for all 4) < 0. 
These are all of the bifurcations that occur in the system (2), and the 
bifurcation set in the y-plane along with the various phase portraits that 
occur in the system (2) are shown in Figure 3 below. 

In order to approximate the shape of the homoclinic-loop bifurcation 
curve HJ, i.e., in order to approximate the function h(j;) for small 1, we 
use the rescaling of coordinates and parameters 


z=e7u, y=erv, pr =en, and po =e? (3) 
with the time t — et, given in [44], in order to reduce the system (2) to a 
perturbed system to which the Melnikov theory developed in Sections 4.9 
and 4.10 applies. Substituting the rescaling transformation (3) into the 
system (2) yields 
“u=v 
0 = yy +u? +e(vyv + uv). 


(4) 


For € = 0, this is a Hamiltonian system with Hamiltonian H(u, v) = v?/2— 
u®/3—v,u. The phase portrait for this Hamiltonian system (2) with e = 0 
is shown in Figure 1 for vy; < 0, in which case there are two critical points 
at (+,/—”,0). Cf. Figure 2 in Section 3.3. 

The homoclinic loop [9 in Figure 1 is given by 


Yo(t) = (uo(t), vo(t)) = /- (1 — 3sech” ( 


vie ()om(5)) 
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Figure 1. The phase portrait for the system (4) with e = 0 and y, < 0. 


Cf. p. 369 in (G/H]. Then, according to Theorem 4 in Section 4.9, the 
Melnikov function along the homoclinic loop [9 is given by 


mv) = [ ” Fly (t)) A B(r0l(t). vat 


il 
rt 
8 


uo(t) [vov0(t) + uo(t)vo(t)|dt 


= 18|v, | 
V2 


oo 
E | sech4 7 tanh? rdr 
-—do 


+V-Y | (1 — 3sech? r) sech* 7 tanh? rdr| 


24|| E | 


Jo 15. 7 
where we have used the fact that sech? 7 = 1 — tanh? 7 and 
; tanh‘ rsech? rdr = <— 
Ses k+1 


Therefore, according to Theorem 4 in Section 4.9, the system (4) with 
v, <0 has a homocliinic loop if 


v2 = s/n + O(e). 
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It then follows from (3) that, for 4; < 0, the system (2) has a homoclinic 
loop if 


He = h(i) = > =i + O(41) 


as 4, — 0. Cf. Figure 3 below. We note that the above computation of 
the Melnikov function M(v) along the homoclinic loop of the system (4) is 
equivalent to the computation carried out in Problem 3 in Section 4.9 since 
the system (4) can be reduced to the system in that problem by translating 
the origin to the saddle x, and by rescaling the coordinates so that the 
distance between the two critical points x4 is equal to one. (Cf. Figure 1 
above and Figure 2 in Section 3.3.) 


Figure 2. Possible variations of the x-intercept of the limit cycle of the 
system (2) for pz, < 0. 


As we have seen, the Melnikov theory, together with the rescaling trans- 
formation (3), allows us to approximate the shape of the homoclinic-loop 
bifurcation curve, HL, near the origin in the y-plane; more importantly, 
however, it also allows us to show that, for small py, < 0, the system (2) 
has exactly one limit cycle for each value of p2 € (h(141), /—H1). In other 
words, no semistable limit cycles occur in the one-parameter family of limit 
cycles generated in the Hopf bifurcation at the origin of system (2) when 
2 = /—p.- This can happen as we saw in the one-parameter family of 
limit cycles Lp in Example 3 of Section 4.9; cf. Figure 9 in Section 4.9. 
In other words, for 4; < 0 the bifurcation diagram for the one-parameter 
family of limit cycles generated in the Hopf bifurcation at the origin of (2) 
when p2 = \/—}) is given by Figure 2(a) and not 2(b). 
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Figure 3. The bifurcation set and the corresponding phase portraits for 
the system (2). 


The fact that there are no semistable limit cycles for the system (2) with 
#4, < 0, such as those that occur at the turning points in Figure 2(b), fol- 
lows from the fact that for uw; <0 and h(y11) < po < /—p; the system (2) 
has a unique limit cycle. This follows from Theorem 5 in Section 4.9, since 
the Melnikov function M(v,a) along the one-parameter family of periodic 
orbits of the rescaled system (4) has exactly one zero. The computation 
of the Melnikov function M(v, a), as well as establishing its monotonicity, 
was carried out by Blows and the author in Example 3.3 in [37]. Cf. Prob- 
lem 3. The unfolding of the normal form (1), i.e., the Takens-Bogdanov 
bifurcation, is summarized in Figure 3, which shows the bifurcation set in 
the y-plane consisting of the saddle-node, Hopf, and homoclinic-loop bi- 
furcation curves SN, H, and HL, respectively, and the Takens-Bogdanov 
bifurcation point, TB, at the origin. The phase portraits for the system (2) 
with parameter values yz on the bifurcation set and in the components of 
the y-plane in the complement of the bifurcation set also are shown in 
Figure 3. 

In his 1974 paper [44], Takens also studies unfoldings of the normal form: 

rT=y 


(5) 


Cf. Problems 2 and 3 in Section 2.13. He studies unfoldings of (5) that 


y = t2° ~- ry. 
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preserve symmetries under rotations through 7, i.e., unfoldings of the form 
r=y 


6 
Y = mitt poyt 2c? — xy. (6) 


Let us first of all consider the case with the plus sign, leaving most of 
the details for the student to do in Problem 4. For p > 0 there is only the 
one critical point at the origin, and it is a topological saddle. For pp, < 0 
there are three critical points, a source at the origin for z2 > 0 and a sink 
at the origin for “2 < 0, as well as two saddles at (+,/—,0). There is 
a pitch-fork bifurcation at points on the po-axis with 2 # 0. There is a 
supercritical Hopf bifurcation at points on the y-axis with p,; < 0. And, 
using the rotated vector field theory in Section 4.6, it follows that for u; <0 
there is a homoclinic-loop bifurcation curve 2 = h(y) = —/5 + (2). 
This approximation of the homoclinic-loop bifurcation curve follows from 
the Melnikov theory in Section 4.9 by making the rescaling transformation 


r=€Eu, y= ey, pf = e271), p2= €7 V9, and t— et; (7) 
cf. [44]. Under this transformation, the system (6) with the plus sign as- 
sumes the form 


u=v 
o= —utu?® + e€v(v — u?) 


where we have set 1; = —1, corresponding to pz; < 0 as on p. 372 of [G/H]. 
But this is just Example 3 in Section 4.10 (with 4; = v2 and po = —1/3); 
cf. Problem 3 in Section 4.10. From Theorem 6 in Section 4.10, it follows 
that for vy; = —1 the homoclinic-loop bifurcation occurs at vg = 1/5+0(e). 
For the system (6) with the plus sign, this corresponds to the fact that the 
homoclinic-loop bifurcation curve in the y-plane is given by 


HL: w2 = h(u) = 1/5 +0(uz) for wi < 0 


as 4, — 0. It is important to note that Theorem 6 in Section 4.10 also es- 
tablishes the fact that there are no multiplicity-two limit cycle bifurcations 
for the system (6) with the plus sign. The student is asked to draw the 
bifurcation set in the yz-plane as well as the corresponding phase portraits 
in Problem 4 below; cf. Figure 7.3.5 in [G/H]. 

We next consider equation (6) with the minus sign, leaving most of the 
details for the student to do in Problem 5. For 4; < 0 there is only one 
critical point at the origin, and it is a sink for w2 < 0 and a source for 
2 > 0. For pz, > O there are three critical points, a saddle at the origin 
and sinks at (+,/11,0) for u2 > m and sources for 2 < py. There is a 
pitch-fork bifurcation at points on the p2-axis with 2 # 0. For pz) < 0 there 
is a supercritical Hopf bifurcation at points on the j-axis, and for p > 0 
there is a subcritical Hopf bifurcation at points on the line weg = pz). Using 
the rotated vector field theory in Section 4.6, it follows that for 4; > 0 
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there is a homoclinic-loop bifurcation curve 2 = h(p1) = 41/5 + O(e?). 
This approximation of the homoclinic-loop bifurcation curve follows from 
the Melnikov theory in Section 4.10 by making the rescaling transformation 
(7) used by Takens in [44]. This transforms equation (6) with the minus 
sign into 

“=v 

v= u—u>+ev(v2 —u’), (8) 
where we have set vy; = +1, corresponding to p, > O as on p. 373 of 
[G/H]. But this is just Example 2 in Section 4.10 (with u, = a = v2 and 
Ho = B/3 = —1/3 as in Problem 1 in Section 4.10). Thus, from Theorem 5 
in Section 4.10, it follows that for vy; = +1 the homoclinic-loop bifurcation 
for the system (8) occurs at vo = —2.4(—1/3) + O(e) = 4/5 + O(e); and 
for the system (6) with the minus sign this corresponds to 2 = h(p) = 
4/5 + 0(u?) as 4, — 0+. Theorem 5 in Section 4.10 also establishes 
that for h(i) < 2 < py there is exactly one limit cycle for this system. 
However, that is not the extent of the bifurcations that occur in the system 
(6) with the minus sign. There is also a curve of multiplicity-two limit cycles 
C2 on which this system has a multiplicity-two semistable limit cycle. This 
follows from the computation of the Melnikov function for the exterior 
Duffing problem in Problem 6 of Section 4.10. It follows from the results of 
that problem that there is a multiplicity-two limit cycle bifurcation surface, 


Co: pip = C(p1) & .752p1 + 0(p?) 


as pt, — 0+. The analyticity of the function C(y) for 0 < py, < 6 and 
small 6 > 0 is established in [39]. Note that it is shown in Problem 1 in 
Section 4.10 that the system (8), the system of Example 2 in Section 4.10 
and the system of Example 3 in Section 4.9 are all equivalent. Also this 
system was studied in Example 3.2 in [37]. It is left for the student to 
draw the bifurcation set in the ps-plane as well as the corresponding phase 
portraits in Problem 5 below; cf. Figure 7.3.9 in [G/H] and Figure 4 below. 

We close this section with one final remark about Takens—Bogdanov or 
double-zero eigenvalue bifurcations. As in Remark 2 in Section 2.13, if 
e + 2a = 0 in the system at the beginning of this section, then the normal 
form for the double-zero eigenvalue is given by 


r=y 


y= ax? + br?y + cx? y. 


However, Dumortier et al. [46] show that, without loss of generality, the 
coefficient b of the z?y-term can be taken as zero, and that it suffices to 
consider unfoldings of the normal form 


r=y 


9 
y=rrtory (9) 
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in this case; cf. Lemma 1, p. 384 in [46]. It is also shown in [46] that a 


universal unfolding of the normal form (9) is given by 
r=y 
e 10 
Y= pi tpoytusryt se? tay, ve 


and this results in a codimension-three Takens-Bogdanov bifurcation, or 
a codimension-three cusp bifurcation if we choose to name the bifurcation 
after the type of critical point that occurs at the origin of (9), i.e., a cusp, as 
was done in [46]. The universal unfolding of (9), given by (10), is described 
in [46]. Cf. the bifurcation set in Figure 1 in Section 4.15. 


: 
SS 


0 Hy 


Figure 4. The bifurcation set in the first quadrant and the corresponding 
phase portraits for the system (6) with the minus sign. 


PROBLEM SET 13 
1. Show that the system (2) with n,; = 0 and po £ 0, 
t=y 
y= poy +2” + zy, 
has a center manifold approximated by y = —r?/po+0(zr°) as x — 0, 


and that this results in a saddle-node at the origin. 


2. Check that the conditions of Theorem 1 in Section 4.2 are satisfied 
by the system (2) with v = (1,0)? and w = (2,—1)", and show 
that for 4; = 0 and po # 0 the system (2) experiences a saddle-node 
bifurcation. 


3. By translating the origin to the center shown in Figure 1 and normal- 
izing the coordinates so that the distance between the critical points 
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in Figure 1 is one [or by translating the origin to the center and set- 
ting v, = —1/4 in (4)], the system (4) can be transformed into the 
system 


L=y 
y= -2+27 + e(ay + Bry). 


Using the same procedure as in Problem 1 in Section 4.10, this system 
can be transformed into the system 


z= y+e(ax + br”) 
y=—c+2? 


with (a,b) = (a, 6/2). This is the system that was studied in [37]. It 
has a one-parameter family of periodic orbits given by 


2/1 —a? + a4 2(1 — a? + a4)3/4’ 
ii (1 _ = ,) 
2 V1 —a? + a4 


and 
(t) = 3a? = t 
yal) 2 — a? + 08) 8/4” \ 2 — a? + a4 


t t 
“2 €; — a2 + ar) si €; — a? + sya?) 


for 0 < a < 1. Following the procedure used in Example 3 in Sec- 
tion 4.10, compute the Melnikov function M(a,a,b) along this one- 
parameter family of periodic orbits using the formulas 


4K(a) ; 4 
| sn°udu = 52K (a) — E(a)] 


ee 4 2 2 
i sn“udu = 3Q4 ((2 + a°)K (a) — 2(1 + a*)E(a@)) 


given in Example 3 in Section 4.10 along with the fact that 
4K(a) 
| sn™ udu = 0 
0 


for any odd positive integer m; cf. [40], p. 191. Graph the values of 
a/b that result in M(a,a,b) = 0, and deduce that for 6 > 0, all 
sufficiently small ¢ > 0, and —26/7 + 0(€) < a < 0, the above system 
has exactly one hyperbolic, unstable limit cycle, born in a subcritical 
Hopf bifurcation at a = 0, that expands monotonically as a decreases 
to the value a(¢) = —2b/7 + O(e). [Note that for », = —1/4, the 
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system (4) has a homoclinic loop at v2 = 5/14 + O(€) according to 
the Melnikov computation in this section. Under the transformation 
of coordinates defined at the beginning of this problem, it can be 
shown that v2 = a+ 1/2 and b = 1/2 if vu, = —1/4. Thus the Hopf 
bifurcation value a = 0 corresponds to v2 = 1/2 = /—W, and the 
homoclinic-loop bifurcation value a = —1/7 + O(€) corresponds to 
vo =a+1/2=5/14+0(e), as given above.| 


4. Consider the system (6) with the plus sign. Verify the statements 
made in this section concerning the critical points and bifurcations 
for that system, draw the bifurcation set in the ys-plane, and construct 
the phase portraits on the bifurcation set as well as for a point in each 
of the components in the complement of the bifurcation set. 


5. Consider the system (6) with the minus sign. Verify the statements 
made in this section concerning the critical points and bifurcations for 
that system, draw the bifurcation set in the y-plane, and construct 
the phase portraits on the bifurcation set as well as for a point in 
each of the components in the complement of the bifurcation set. 


6. Draw the bifurcation set and corresponding phase portraits for the 
system 
tT=y 
y= t poy tx? — zy. 
Hint: Apply the transformation of coordinates (z,y,t, 41,2) — 


(x. —y. —t. 14}, 2) to the system (2) and to the results obtained 
for the system (2) at the beginning of this section. 


7. Draw the bifurcation set and corresponding phase portraits for the 
system 
r=y 
y= pit poy t 2’. 


Hint: For pz = 0, note that the system is symmetric with respect to 
the z-axis and apply Theorem 6 in Section 2.10. 


4.14 Coppel’s Problem for Bounded Quadratic 
Systems 


In 1966, Coppel [47] posed the problem of determining all possible phase 
portraits for quadratic systems in R? and classifying them by means of al- 
gebraic inequalities on the coefficients. This is a rather formidable problem 
and, in particular, a solution of Coppel’s problem would include a solution 
of Hilbert’s 16th problem for quadratic systems. It was pointed out by Du- 
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mortier and Fiddelaers that Coppel’s problem as stated is insoluble; i.e., 
they pointed out that the phase portraits for quadratic systems cannot be 
classified by means of algebraic inequalities on the coefficients, but require 
analytic and even nonanalytic inequalities for their classification. 

In 1968, Dickson and I initiated the study of bounded quadratic sys- 
tems, i.e., quadratic systems that have all of their trajectories bounded for 
t > 0; cf. [48]. In that study we were looking for a subclass of the class 
of quadratic systems that was more amenable to solution and exhibited 
niost of the interesting dynamical behavior found in the class of quadratic 
systems. In [48] we established necessary and sufficient conditions for a 
quadratic system to be bounded and determined all possible phase por- 
traits for bounded quadratic systems with a partial classification of the 
phase portraits by means of algebraic inequalities on the coefficients. 

This section contains a partial solution to Coppel’s problem for bounded 
quadratic systems, modified to include analytic inequalities on the coeffi- 
cients (i.e., inequalities involving analytic functions), under the assumption 
that any bounded quadratic system has at most two limit cycles. It is amaz- 
ing that in 1900 Hilbert [49] was able to formulate the single most difficult 
problem for planar polynomial systems: to determine the maximum num- 
ber and relative positions of the limit cycles for an nth-degree polynomial 
system. This is still an open problem for quadratic systems; however, we 
do know that there are quadratic systems with as many as four limit cycles 
(cf. (29]), and that any quadratic system has at most three local limit cycles 
(cf. [2]). The results on the number of limit cycles for bounded quadratic 
systems are somewhat more complete. First, it was shown in [48] that any 
bounded quadratic system has at most three critical points in R?. And in 
1987 Coll et al. [50] were able to prove that any bounded quadratic system 
with one or two critical points in R? has at most one limit cycle. It also 
was shown in [50] that any bounded quadratic system has at most two 
local limit cycles and that there are bounded quadratic systems with three 
critical points in R? that have two local limit cycles. And just recently, 
Li et al. [51], using the global Melnikov method described in Section 4.10, 
were able to show that any bounded quadratic system that is near a center 
has at most two limit cycles. The conjecture, posed by the author, that 
any bounded quadratic system has at most two limit cycles is therefore 
reasonable, and it is consistent with all of the known results for bounded 
quadratic systenis. 

Since, according to [50], any bounded quadratic system with one or two 
critical points in R? has at most one limit cycle, it was possible, using 
some of the author's results for establishing the existence and analyticity 
of homoclinic-loop bifurcation surfaces in [38], to solve Coppel’s problem (as 
stated in [47]) for bounded quadratic systems with one critical point or for 
bounded quadratic systems with two critical points (if we allow analytic 
inequalities on the coefficients). These results are given below; they are 
closely related to Theorem C in [50]. The solution of Coppel’s problem 
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for bounded quadratic systems (as stated below, where we allow analytic 
inequalities on the coefficients), under the assumption that any bounded 
quadratic system (with three critical points in R?) has at most two limit 
cycles, also is given in this section; however, it still remains to show exactly 
how the bifurcation surfaces in Theorem 5 below partition the parameter 
space of the system (5) in Theorem 5 into components for 6 < 0. This is 
accomplished for @ > 0 in Figures 15 and 16 below; but for 8 < 0 it is still 
not completely clear how the codimension 3 Takens—Bogdanov bifurcation 
surface (described in Theorem 4 and Figure 1 in the next section) interact 
with the other bifurcation surfaces for bounded quadratic systems. 


Coppel’s Problem for Bounded Quadratic Systems. Determine all 
of the possible phase portraits for bounded quadratic systems in R? and 
classify them by means of inequalities on the coefficients involving functions 
that are analytic on their domains of definition. 


In this section we see that there is a rich structure in both the dynamics 
and the bifurcations that occur in the class of bounded quadratic systems: 
Their phase portraits exhibit multiple limit cycles, homoclinic loops, sad- 
dle connections on the Poincaré sphere, and two limit cycles in either the 
(1, 1) or (2,0) configurations; while the evolution of their phase portraits in- 
cludes Hopf, homoclinic-loop, multiple limit cycle, saddle-node and Takens— 
Bogdanov bifurcations. It will be seen that the families of multiplicity-two 
limit cycles that occur in the class of bounded quadratic systems termi- 
nate at either a homoclinic-loop bifurcation at “resonant eigenvalues” as 
described in (38, 39, 52], at a multiple Hopf bifurcation, or at a degenerate 
critical point as described in [39]. 

The main tools used to establish the results in this section are the theory 
of rotated vector fields developed in (7, 23] and presented in Section 4.6 and 
the results on homoclinic-loop bifurcation surfaces and multiple limit cycle 
bifurcation surfaces and their termination developed in (38, 39, 52]. The 
asymptotic results given in [51] serve as a nice check on the results of this 
section for bounded quadratic systems near a center, and they complement 
the numerical results in this section that describe the multiplicity-two limit 
cycle bifurcation surfaces whose existence follows from the theory of rotated 
vector fields as in [38]. In the problem set at the end of this section, the 
student is asked to determine the bifurcation surfaces that occur in the 
class of bounded quadratic systems. This serves as a nice application of 
the bifurcation theory that is developed in this chapter, and it allows the 
student to work on a problem of current research interest. 

Let us begin by presenting some well-known results for BQS (i.e., for 
Bounded Quadratic Systems). The following theorem is Theorem 1 in [48]: 


Theorem 1. Any BQS is affinely equivalent to 
a Q)12z 
y = aq)r + agey + ry (1) 
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with ay; <0 and agq < 0, or 


f=ayrtapyt+y* 
y = a22y (2) 
with a,,; < 0,aeq < 0, and a,; + agg < 0; or 


f=ayrt+apyt+y* 
¥ = aq 2 + aggy — ry + cy? (3) 


with |c| < 2 and either (i) a,, < 0, (ii) aj; = 0 and ag, = 0, or (iii) a); = 0, 
a2; #0, aj2 + aq) = 0, and cay, + agq < 0. 


As we shall sce in the next two theorems, the BQS determined by (1) 
and (2), and also those determined by certain cases of (3) in Theorem 1, 
have either only one critical point or a continuum of critical points. The 
latter cases are integrable, and the cases with one critical point are easily 
treated using the results in [48] and [50]. The most interesting cases are 
those BQSs with two or three critical points which are determined by the 
remaining cases of system (3) in Theorem 1; cf. Theorems 4 and 5 below. 

The solution to Coppel’s problem for BQS1 and BQS2 (i.e., BQS with 
one or two critical points in R?, respectively) and for BQS with a continuum 
of critical points is given in the next three theorems, where we also give 
their global phase portraits. The first theorem follows from Lemmas 1, 3, 
4, 15, 16, and 17 in [48] and the fact that any BQS1 has at most one limit 
cycle which was established in [50]. Note that it was pointed out in [50] 
that the phase portrait shown in Figure 1(b) was missing in [48]. 


Theorem 2. The phase portrait of any BQS1 is determined by one of the 
separatriz configurations in Figure 1. Furthermore, the phase portrait of a 
quadratic system is given by Figure 1 


(a) iff the quadratic system is affinely equivalent to (1) with a,,; <0 and 
ago < 0; 


(b) iff the quadratic system is affinely equivalent to (2) with a,, < 2agq < 
0; 


(c) iff the quadratic system is affinely equivalent to (2) with 2ag2 < a\; < 
0 or (3) with |c| < 2 and either 


(i) Q1, = Q12 + a2, = 0,a2,; A 0 and az2 < min(0, —ca21) or age 
0 < -—caz), 


(ii) a1) < 0, (a12 —@21 +0011)? < 4(a11@22 —€21412), and aj; +a22 < 
0, or 


(iii) aj) <0 and (aj2 — a2, + cay1) = (@11€22 — 21412) = 0; 


(d) iff the quadratic system is affinely equivalent to (3) with |c| < 2 and 
either 
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(i) aj; = ay2 + a2, = 0 and 0 < ag2 < —cag}, or 


(ii) a1, < 0,011 + ag2 > 0, and (aig — a2, + C011)? < 4(ai1022 — 
@1221). 


(a) (b) 


(c) 


Figure 1. All possible phase portraits for BQS1. 


We next give the results for BQS with a continuum of equilibrium points. 


As in [48], these cases all reduce to integrable systems; cf. Figure 10, 11, 
12, 14, and 15, in (48). 


Theorem 3. The phase portrait of any BQS with a continuum of equilib- 
rium points is determined by one of the configurations in Figure 2. Fur- 
thermore, the phase portrait of a quadratic system is given by Figure 2 


(a) iff the quadratic system is affinely equivalent to (1) with a,; <0 and 
a22 = 0; 


(b) iff the quadratic system is affinely equivalent to (2) with a,; = 0 and 
a22 < 0; 


(c) iff the quadratic system is affinely equivalent to (2) with a\,; <0 and 
a22 = 0; 
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POS 
SOS 
OOS 


Figure 2. All possible phase portraits for a BQS with a continuum of 
equilibrium points. 


(d) iff the quadratic system is affinely equivalent to (3) with aj; = aq; = 0 
and -2<c<0; 


(e) iff the quadratic system is affinely equivalent to (3) with aj; = a2, = 
c=0; 

(f) «ff the quadratic system is affinely equivalent to (3) with a,; = aq; = 0 
and0<c< 2; 


(g) iff the quadratic system is affinely equivalent to (3) with aj; = aj2 + 
Q2) = Cag) + agg = 0, a2; #0, and —-2<c< (0; 


(h) iff the quadratic system is affinely equivalent to (3) with a\,; = ajo + 
Q21 = agg = c= 0 and ag; #0; 
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(i) iff the quadratic system is affinely equivalent to (3) with a\,; = aj2 + 
Q21 = CA21 + Aoq = 0, aq, #0, and0<c< 2. 


Remark 1. Note that the classification of the phase portraits in Theo- 
rems 2 and 3 is determined by algebraic inequalities on the coefficients. 
Also, it follows from Theorem 3 and the results in [48] that any BQS with 
a center is affinely equivalent to (3) with a); = aj2 + ao, = agg =c = 0 
and ao, # 0, and that the corresponding phase portrait is determined by 
Figure 2(h). 


We next present the solution to Coppel’s problem for BQS2. In this case, 
there is a homoclinic-loop bifurcation surface whose analyticity follows from 
the results in [38]. Due to the existence of the homoclinic-loop bifurcation 
surface, the phase portraits of BQS2 cannot be classified by means of alge- 
braic inequalities on the coefficients. However, any BQS2 has at most one 
limit cycle according to [50], and we therefore are able to solve Coppel’s 
problem for BQS2 as stated at the beginning of this section. 

First, note that it follows from Theorem 1 above and Lemma 8 in [48] that 
any BQS2 is affinely equivalent to (3) with |c| < 2,a1; < 0,a,2—a2)+ca;; # 
O, and either (a)2—a2 +ca);)? = 4(a)1@299—@2)4)2) or (@1@22—@214)2) = 0. 
As in [48] on p. 265, by translating the origin to the degenerate critical 
point of (3), it follows that any BQS2 is affinely equivalent to (3) with 
\c| < 2,a1 < 0, a)2 — aq, + ca, #0 and a) a92 — a214)2 = 0. For aj, < 0, 
by making the linear transformation of coordinates t — |a},|t,z — |a;,| 
and y — y/|aj,|, it follows that any BQS2 is affinely equivalent to 


t= —-z+apyt+y” (3") 

y = aq z+ aggy — ry + cy” 
with |c| < 2,a9,; — aj32 +c # 0, and agg = —ag)a)9. Finally, by letting 
B = aj2 and @ = ag; +c, in which case agg = —aj29a9q, = Bc — af and 
a # B, we obtain the following result: 


Lemma 1. Any BQS2 ts affinely equivalent to the one-parameter family 
of rotated vector fields 


£ —r+Byt+y’ 
y = az — aBy — ry +c(—r + By + y”) 


mod xz = By + y* with parameter c € (—2,2) and a # B. Furthermore, the 
system (4) ts invariant under the transformation (z,y,t,a,B,c) — (x — 
y,t, -a,—B,—c), and it therefore suffices to consider a > B. The critical 
points of (4) are at 0 = (0,0) and Pt = (zt, y*) with r+ = a(a — B) and 
yt =a — B; P* is a node or focus, and 0 is a saddle-node or cusp; and 0 
is a cusp iffc=a+t+1/B. 


(4) 


The last statement in Lemma 1 follows directly from the results in 
Lemma 8 in [48] regarding the critical points of (3). We next consider 
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the bifurcations that take place in the three-dimensional parameter space 
of (4). By translating the origin to the critical point Pt of (4), it is easy 
to show that there is a Hopf bifurcation at the critical point P* for any 
point (a, @,c) on the Hopf bifurcation surface 

_ 1+a? 

~ a—B 

in R?. This computation is carried out in Problem 1, where it also is shown 
by computing the Liapunov number at the weak focus of (4), o, given by 
(3’) in Section 4.4, that Pt is a stable weak focus and that a supercritical 
Hopf bifurcation of multiplicity one occurs at points on H* as c increases. 
The Hopf bifurcation surface H* is shown in Figure 3. Note that for a > £, 
the surface H* lies above the plane c = 2 for 8 > 3/2. 


Ht:c 


———— 


-1 0 1 


no @ 8 See 4 ee riot mete 


Figure 3. The Hopf bifurcation surface H*. 


According to the theory of rotated vector fields in Section 4.6, the stable 
(negatively oriented) limit cycle of the system (4), generated in the Hopf 
bifurcation at c = (1+ a?)/(2a — 3), expands monotonically as c increases 
from this value until it intersects the saddle-node at 0 and forms a sepa- 
ratrix cycle around the critical point P+; cf. Problem 6. This results in a 
homoclinic-loop bifurcation at a value of c = h(a, GB), and, according to the 
results in (38}, the function h(a, @) is an analytic function of a and ( for all 
(a, B) € R? with 2a — 6 £ 0. Thus we have a homoclinic-loop bifurcation 
surface 


HL*:c= h(a, 8). 
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A portion of the homoclinic-loop bifurcation surface H L* , determined nu- 
merically by integrating trajectories of (4), is shown in Figure 4. 


1 0 1 


Figure 4. The homoclinic-loop bifurcation surface HLt. 


It follows from Lemma 11 in [48] that (4) has a saddle-saddle connection 
between the saddle-node at the origin and the saddle-node at the point 
(1,0,0) on the equator of the Poincaré sphere iff c = a. This plane in R? 
determines the “saddle-saddle bifurcation surface” 


SS:c = a. 


There is one other bifurcation that occurs in the class of BQS2 given by (4): 
A cusp or Takens-Bogdanov bifurcation occurs when both the determinant 
and the trace of the linear part of (4) are equal to zero (i.e., when the 
linear part of (4) has two zero eigenvalues); cf. Section 4.13. The Takens- 
Bogdanov bifurcation, for which (4) has a cusp at the origin, is derived in 
Problem 2 and it occurs for points on the surface 
Dine ia 
TBe:c=at B 
These are the only bifurcations that occur in the class BQS2 according 
to Peixoto’s theorem in Section 4.1. We shall refer to the plane a = G as 
a saddle-node bifurcation surface since P+ — 0 as a — @ in (4); i.e., as 
shown in Problem 3, there is a saddle-node bifurcation surface 


SN:a = £. 


For a = (3 the system (4) has only one critical point which is located at the 
origin: and the phase portrait for (4) with a = @ is given by Figure 1(c). 
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The relationship of the bifurcation surfaces described above for |c| < 2 
is determined by Figure 6 below, which shows the bifurcation surfaces in 
this section for various valucs of @ in the intervals (—oo, —2), [—2, —1/2), 
(—1/2, 0), (0, B*), [@*, 3/2), [3/2, 2), and [2, co). The number @* = 1.43; this 
is the value of 6 at which the homoclinic-loop bifurcation surface H Lt 
leaves the region in R? where |c| < 2; cf. Figure 4. The phase portraits for 
(4) with (a, @,c) in the various regions shown in the “charts” in Figure 6 
follow from the results in [48] for BQS2 and from the fact that any BQS2 
has at most one limit cycle, which was established in [50]. These results then 
lead to the following theorem. Note that the configuration (a’), referred to 
in Figure 6, is obtained from the configuration (a), shown in Figure 5, by 
rotating that configuration through 7 radians about the z-axis. Similar 
statements hold for the configurations (b’),..., (j’). 


Theorem 4. The phase portrait for any BQS2 is determined by one of the 

separatriz configurations in Figure 5. Furthermore, there exists a homoclinic- 
loop bifurcation function h(a, B) that is defined and analytic for alla # 

B/2. The bifurcation surfaces 


1+ a? 

[eee 
fe = a B’ 
HL*:c= h(a, B), 

SS:c=a, 

and l 
TB’:c=at+-— 
B 


partition the region 
R = {(a, B,c) € R? | a > B, |e| < 2} 


of parameters for the system (4) into components, the specific phase portrait 
that occurs for the system (4) with (a, G,c) in any one of these components 
being determined by the charts in Figure 6. 


Remark 2. The components of the region R defined in Theorem 4 and 
described by the charts in Figure 6 also can be described by analytic in- 
equalities on the coefficients a, G, and c in (4). In fact, it can be seen from 
the last three charts shown in Figure 6 that for B < 0,a > £B, and |c| < 2, 
the system (4) has the phase portrait determined by Figure 5 


(a) iffc =a and c < (1+.2)/(2a — 8). 

(b) iff c =a and c> (1+ a)/(2a — £). 

(c') iffa+1/B<c<aandc < (1+a?)/(2a— 8). 
(c}) iffa <c<(1+a?)/(20— 8B). 
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(d) iff c > a and (1 + a”)/(2a — B) < c < h(a, B). 
(e) iff c= h(a, B). 

(f) iff (1+ a?)/(2a — B) <c<a+1/f. 

(g’) iffa+1/B<c<aandc> (1+a?)/(2a— 8). 
(hi) iff c < (1+ a7)/(2a — B) andc<a+1/f. 

(h) iff c > h(a, B). 

(i) iffe =a+1/B andc< (1+ a7)/(2a — 8). 

(j’) iff c=a+1/B8 and c> (1+a)/(2a— £). 


Similar results follow from the first four charts in Figure 6 for GB > 0. In fact, 
the configurations f’, hj, i’, and j/ do not occur for 6 > 0; the inequalities 
necessary and sufficient for c’ or g’ are c < a andc < (1+a”)/(2a— #) or 
c > (1+ a”)/(2a — B), respectively; and the above inequalities necessary 
and sufficient for the configurations a, b, c,, d, e, and h remain unchanged 
for B > 0. 


Note that the system (4) with a > @ > 2 and |c| < 2 has the single phase 
portrait determined by the separatrix configuration in Figure 5(c’). Also 
note that, due to the symmetry of the system (4) cited in Lemma 1, if for 
a given c € (—2, 2), 8 € (—00, 00), and a > @ the system (4) has one of the 
configurations a, b, c’, c,, d, e, f, g’, h’, hy, i’ or j/ described in Figure 5, 
then the system (4) with —a and —( in place of a and G (and —a < —), 
and with —c in place of c, will have the corresponding configuration a’, b’, 
c, c}, d’, e’, f, g, h, hij, i, or j, respectively. We see that every one of the 
configurations in Figure 5 (or one of these configurations rotated about the 
z-axis) is realized for some parameter values in the last chart in Figure 6. 
The labeling of the phase portraits in Figure 5 was chosen to correspond 
to the labeling of the phase portraits for BQS3 in Figure 8 below. 

It is instructive to see how the results of Theorem 4, together with the 
algebraic formula for the surface H* given in Theorem 4 and with the 
analytic surface HL*+ approximated by the numerical results in Figure 4, 
can be used to determine the specific phase portrait that occurs for a given 
BQS2 of the form (4). 


Example 1. Consider the BQS2 given by (4) with a = 1 and GB = 4€ 
(0, B*), ie., by 
z= —2+.4y+y? ; 
2 (4’) 
y=r-— 4y—syt+c—-r+ 4y+y’), 


where we let c = 1.2, 1.3, 1.375, and 1.5. Cf. the fourth chart in Figure 6. 
It then follows from Theorem 4 and Figures 3 and 4 that this BQS2 with 
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(c,) 


(i) 


(hy) 


Figure 5. All possible phase portraits for BQS2. 
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—2<B<-1/2 


Figure 6. The charts in the (a,c)-plane for the BQS2, (4). 


c = 1.2,1.3, 1.375, and 1.5 has its phase portrait determined by Figures 5 
(c;), (d), (e), and (h) respectively. This is borne out by the numerical results 
shown in Figure 7. Of course, the computer-drawn phase portrait for c = 
1.375 only approximates the homoclinic loop that occurs at c = 1.375---. 


We. next present the solution to Coppel’s problem for BQS3 under the 
assumption that any BQS3 has at most two limit cycles. It has been shown 
in [51] that any BQS3 which is near a center has at most two limit cycles, 
and, because of the results presented in this section and in [53], we believe 
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i= 

{ 
X 

\ 


C = 1.375 C=1.5 


Figure 7. Computer-drawn phase portraits for the system (4’). 


that it is true in general that any BQS3 (and therefore any BQS) has at 
most two limit cycles. 

As we shall see, the class BQS3 has both homoclinic-loop and multiplicity- 
two limit cycle bifurcation surfaces that are described by functions whose 
analyticity follows from the results in [38]. Thus, just as in the case of 
BQS2, it is once again necessary to allow inequalities involving analytic 
functions in the solution of Coppel’s problem for BQS3. 

It follows from Theorem 1 above and Lemma 8 in [48] that any BQS3 is 
affinely equivalent to (3) with |c| < 2,a,; <0, and (aj2 — ag; + ca);)? > 
4(a11@22 — @210€;2) # 0. It was shown in [48] that for any BQS3 of the 
form (3), the middle critical point (ordered according to the size of the 


4.14. Coppel’s Problem for Bounded Quadratic Systems 501 


y-component of the critical point) is a saddle. Thus, by translating the 
origin to the lower critical point and by making the linear transformation 
of coordinates t > |a,,|t.2 — x/|a,,| and y — y/|ay,| in (3) with a,, < 0, 
it follows that any BQS3 is affinely equivalent to (3’) above with |c| < 2 
and (a2) — ai2 +c)? > 4(—ag2 — a2a2;) > 0. Therefore, by letting 3 = 
a\2,@ = a2; +c, and 7? = —ag2 — a214)2, a positive quantity, it follows 
from the above inequalities that |a — 3| > 2|y7| > 0, and we obtain the 
following result: 


Lemma 2. Any BQS3 is affinely equivalent to the one-parameter family 
of rotated vector fields 


x 


—r+By+y? 


y = ar - (a8 +7*)y- zy +c(-r + By +y”) ee 
niod x = By+y? with parameter c € (—2,2) and |a—(3| > 2|y| > 0. Further- 
more, the system is invariant under the transformation (rz, y, t,a, 3,7,c) > 
(x, -y,t, -a.—G,-y,—c), and it therefore suffices to consider a — 3 > 
27 > 0. The critical points of (5) are at 0 = (0,0), Pt = (xt, yt), and 
P- =(a~.y) with z* = (6+y*)y* and 2y* = a—B+[(a—f)? -47]'/?. 
The origin and P* are nodes or foci, and P~ is a saddle. The y-components 
of 0.P~, and P* satisfy 0 < y~ < yt; 2e.,0,P~, and P* are in the rel- 
ative positions shown in the following diagram: 


p+ 


eO 


The last statements in Lemma 2 follow directly from the results in 
Lemma 8 in [48] regarding the critical points of (3). The bifurcations 
that take place in the four-dimensional parameter space of (5) are de- 
rived in the problems at the end of this section. Hopf and homoclinic-loop 
bifurcations occur at both 0 and Pt; these bifurcation surfaces are de- 
noted by H+,H°,HL+, and HL®; cf. Problems 1, 5, and 6. There are 
also multiplicity-two Hopf bifurcations that occur at points in H+ and H®; 
these surfaces are denoted by Hj and H9; cf. Problems 1 and 5. Note that 
it was shown in Proposition C5 in [50] that there are no multiplicity-two 
Hopf bifurcations for BQS1 and BQS2, and that there are no multiplicity- 
three Hopf bifurcations for BQS3. There are multiplicity-two homoclinic- 
loop bifurcations that occur in HL*, as is shown in Problem 7 at the 
end of this section, and this surface is denoted by HLJ. Also, just as in 
the class BQS2, it follows from Lemma 11 in [48] that the class BQS3 
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has a saddle-saddle bifurcation surface 
SS:c =(a+8+S)/2. 


where S = \/(a — (3)? — 4y?. and for (a, 3.7,c) € SS the system (5) has 
a saddle-saddle connection between the saddle P~ and the saddle-node at 
the point (1,0,0) on the equator of the Poincaré sphere. There is also a 
saddle-node bifurcation that occurs as a > 3 + 24; i.e.. as P* — P~, and 
this results in the following saddle-node bifurcation surface for (5): 


SN:a = 34 2%. 


Cf. Problem 3. 

Next we point out that there is a Takens-Bogdanov (or cusp) bifurcation 
surface TB* that occurs at points where H+ intersects HL*+ on SN;; i.e., 
as in Figure 3 in Section 4.13, TB* = H*N HLt SN. As is shown in 
Problem 4, it is given by 


TBt:c 


= +B+ and a=(34+2y%. 
5425 ¥ B+ 2y 
It is shown in Problem 8 that there is a transcritical bifurcation that occurs 
as y — 0: ie.. as 0 — P-, and this results in the following transcritical 


bifurcation surface for (5): 
TC: 7 = 0. 


Finally. as was noted earlier. there is the Takens-Bogdanov (or cusp) bi- 
furcation surface TB° that occurs at points where H® intersects HL® on 
TC; i.e., TB° = H°NHL® NTC. Cf. Problems 2 and 3. It is given by 


l 
TB®:c=a+-: 
B 


cf. Theorem 4 above. All of these bifurcations are derived in the problem 
set at the end of this section, including the multiplicity-two limit cycle 
bifurcation surfaces Cf and C2 whose existence and analyticity follow from 
the results in [38]: cf. Problem 6. These bifurcation surfaces for BQS3 are 
listed in the next theorem, where they are described by either algebraic 
or analytic functions of the parameters a, 3,7, and c that appear in (5). 
Furthermore, these are the only bifurcations that occur in the class BQS3, 
according to Peixoto’s theorem. 

The relative positions of the bifurcation surfaces described above and in 
Theorem 5 below are determined by the atlas and charts for the system (5) 
given in Figures A and C in [53] and shown in Figures 15 and 16 below for 
3 > 0. The phase portraits for (5) with (a, 3,.c) in the various compo- 
nents of the region R, defined in Theorem 5 below and determined by the 
atlas and charts, in [53], follow from the results in [48] for BQS3 under the 
assumption that any BQS3 has at most two limit cycles. These results are 
summarized in the following theorem. 
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Theorem 5. Under the assumption that any BQS3 has at most two limit 
cycles, the phase portrait for any BQS3 is determined by one of the sepa- 
ratriz configurations in Figure 8. Furthermore, there exist homoclinic-loop 
and multiplicity-two limit cycle bifurcation functions h(a, 3,7), ho(a, 8,7), 


f(a, B,7), and fo(a,B,7), analytic on their domains of definition, such 
that the bifurcation surfaces 


_ 1l+a(a+fh+S)/2 
~ a+s 


Ht:c 


(e) (f) (9) (n) 


Figure 8. All possible phase portraits for BQS3. 
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ae, 2a : 
1+7? 
H®:c=at ; 
B 
H9.¢ = G8 = 20° -1+ (aB — 2a? — 1)? — 4(a — B)(B — 2a) 
0 eS Oe 


2(G — 2a) 
HLt:c= h(a, B,), 
pp ee eee oe +P au. 
HL®:c= ho(a, 8,7), 
SS:c =(a+6+4+S)/2 or a=ct+7*/(c— 8), 
Cy:c = f(a, B, 7), 
and 


Cz:¢ = fo(a, B,) 


with S = \/(a— B)? — 477, a = 2(25 — B), b= (a+ B — S)(B — 2S) +2, 
and d= 6 —a-—3S partition the region 


R = {(a, B,7,c) ER‘ |a>B+27,7>0, |e < 2} 


of parameters for the system (5) into components, the specific phase portrait 
that occurs for the system (5) with (a, G,7,c) in any one of these compo- 
nents being determined by the atlas and charts in Figures A and C in [53], 
which are shown in Figures 15 and 16 below for B > 0. 


The purpose of the atlas and charts presented in [53] and derived below 
for B > 0 is to show how the bifurcation surfaces defined in Theorem 5 
partition the region of parameters for the system (5), 


R= {(a,B,y,c) €R*|a > B+ 27,7 > 0, |c| < 2}, 


into components and to specify which phase portrait in Figure 8 corre- 
sponds to each of these components. 

The “atlas,” shown in Figure A in [53] and in Figure 15 below for 6 > 0, 
gives a partition of the upper half of the (G,7)-plane into components 
together with a chart for each of these components. The charts are specified 
by the numbers in the atlas in Figure A. Each of the charts 1-5 in Figure 16 
determines a partition of the region 


E = {(a,c) € R? |a > B+ 24, |c| < 2} 


in the (a, c)-plane into components (determined by the bifurcation surfaces 
H+,...,C9 in Theorem 5) together with the phase portrait from Figure 8 
that corresponds to each of these components. The phase portraits are 
denoted by a-o or a’-o’ in the charts in Figure C in [53] and in Figure 16 
below. As was mentioned earlier, the phase portraits a’—-o’ are obtained by 
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rotating the corresponding phase portraits a-o throughout 7 radians about 
the x-axis. 

In the atlas in Figure 15, each of the curves T),...,I°4 that partition the 
first quadrant of the (G,-y)-plane into components defines a fairly simple 
event that takes place regarding the relative positions of the bifurcation 
surfaces defined in Theorem 5. For example, the saddle-saddle connection 
bifurcation surface SS, defined in Theorem 5, intersects the region FE in 
the (a,c)-plane iff 6 + y < 2. (This fact is derived below.) Cf. Charts 1 
and 2 in Figure 16 where we see that for all (a,c) € E and 6+ 7 > 2 the 
system (5) has the single phase portrait c’ determined by Figure 8. 

In what follows, we describe each of the curves T),...,I4 that appear in 
the atlas in Figure 15 as well as what happens to the bifurcation surfaces 
in Theorem 5 as we cross these curves. 


A. IT#:SS INTERSECTS SN ON c= +2 
From Theorem 5, the bifurcation surfaces SS and SN are given by 


SS:cn CTBtS 
2 
and 
SN:a = B+ 247, 


respectively, where S = ,/(a — (3)? — 47”. Substituting a = +27 into the 
equation for S shows that S = 0 on SN; substituting those quantities into 
the SS equation shows that SS intersects SN at the point 


SSOSN:a=B+2y, c=B+y¥. 
Thus SS intersects SN on c = +2 iff (6,7) € T¥, where 
lf: 6+7= +2. 


It follows that in the (a,c)-plane the SS and SN curves have the relative 
positions shown in Figure 9. 


B. IT#:TBt INTERSECTS SN ON c= +2 


As was determined in Problem 4, a Takens—Bogdanov bifurcation occurs 
at the critical point P+ of the system (5), given in Lemma 2, for points on 
the Takens—Bogdanov surface 


Setting c = +2 in this equation determines the curves 


1 
a —4 
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B+y>2 —2<B+Y<2 B+Y¥<-2 


Figure 9. The position of the SS curve in the (a, c)-plane. 


; 

rt 
3 4 
Cc 

; : ; 

B 
A 
70 =5 0 B 


Figure 10. The curves If in the (G,7)-plane. 


where the point p€ TB+ NSN enters and leaves the region |c| < 2 in the 
(a, c)-plane, respectively. The curves [? are shown in Figure 10. For points 
(G,7y) in between these two curves we have a Takens—Bogdanov bifurcation 
point TBt in the closure of the region E in the (a, c)-plane; cf. Figure 11 
and charts 4 and 5 in Figure 16. 
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TBt 
! 
c=2 c=2 c=2 
SN H Ht 
SN 
c=-2 C=-2 


(B,Y)EA (B, Y)€B (B, Y)EC 


Tat 


Figure 11. The position of the TB* point in the (a, c)-plane. 


C. IT.:H* INTERSECTS c= 2 


First, consider the case when 7 = 0. In this case, it follows from Theorem 4 


that 
_ 1+¢? 
~ Ya B 
It then follows that Oc/Oa = 0 iff a2 -af—1=0 and that for any 6 € R, 
the H* curve has a minimum at a = (6+ \/ 6? + 4)/2. This minimum point 
occurs at the intersection of the SS and H* curves in the (a, c)-plane. (This 
follows since for ~ = 0,c = a on the SS curve, and substituting c = a into 
the above formula for H+ yields a? — a@ — 1 = 0.) Thus, for 7 = 0, the 
minimum point on the H* curve intersects the horizontal line c = 2 at 
the point c = a = (GB = 62 + 4)/2 = 2, which implies that B = 3/2; cf. 
Figure 6. 

Next consider the case when ¥ > 0. In this case, it follows from Theorem 5 


that ; aa 
Hee +a(a+B+S)/ 
at+S 


where S = ,/(a — £8)? — 4y?. Once again, we set Oc/Oa = 0 to find the 
minimum point on the H* curve (when it exists). This yields 


(2a + B)S? + [a? — 2+ (a — B)* — 47"]5 — (a — B)(2+aB)=0. (#) 
And setting c = 2 in the H* equation yields 
24+ (a—4)S+a(at+fB—4) =0. (+*) 


Eliminating a between the two equations (*) and (+**) then yields the 
curve 


H*:c 


? 


P2:7 = Y2(8) 
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-| 0 ] 3/2 


Figure 12. The curve [2 in the (7. y)-plane. 


. ; Y> Y2 (B) 
, ¥> ¥> (B) , Y>¥>(B) 

Ht { Ht 

¥<Y, (B) ¥< 2 (B) 

Ht 
SN 

C=-2 

-1/2<B <3 B=-1/2 B< -1/2 


Figure 13. The position of the H+ curve in the (a.c)-plane. 


in the (G,7)-plane, where H* first intersects the horizontal line c = 2 
in the (a,c)-plane: cf. Figures 12 and 13. The curve [2 was determined 
numerically; it is shown in Figure 12 and in the atlas in Figure 15 below. 
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T's: y = 73(8) 


-] 0 1 B" 32 


Figure 14. The curve I3 in the (, y)-plane. 


D. I[3:HL+ INTERSECTS c= 2 


For y = 0, it was noted just prior to Theorem 4 above that the homoclinic 
loop bifurcation surface H Lt intersects the region |c|] < 2 iff @ < 6*, where 
B* = 1.43 was determined numerically. Cf. Figure 4. 

For 7 > 0, it has been determined numerically, by integrating trajectories 
of (5), that for —} < 6 < B*, the HL* curve intersects the region |c| < 2 
iff the point (G,y) lies below the curve 


P'3: 7 = 73(8) 


in the (8, )-plane. Cf. Figure 14, where we see that the curve [3 parallels 
the [2 curve in the (@,7)-plane, going from the point (6*,0) to the point 
(-3, 23) common to I'2,T3, and re. This is not surprising since the H Lt 
curves “parallel” the H+ and SS curves in the (a, c)-plane. The [2 and rs 
curves are shown in Figure 14. 


THE ATLAS IN THE FIRST QUADRANT 


At this point we can determine exactly which phase portrait occurs in the 
system (5) for (a, G,7,c) € R with B > 0. The curves ['f ,T'2,T3, and If, 
discussed above, are shown in Figure 15 together with the chart numbers 
1-5 that correspond to each of the components in the first quadrant of 
the ((,7)-plane that are determined by the curves ['f-I'f. We also show 
charts 1-5 in Figure 16 and the phase portraits that occur in these charts 
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Figure 15. The atlas A in the first quadrant of the (G, 7)-plane. 


Figure 16. The charts in the (a, c)-plane, that appear in the first quadrant 
of the atlas A shown in Figure 15. 
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(i) 


Figure 17. The phase portraits that occur in the charts shown in Figure 16; 
cf. Figure 8 (and Figure 5 for c,c, and i on SN). 


in Figure 17. This should give the student a very good idea of how the 
results in this section allow us to determine the phase portrait of any BQS 
of the form (5) with 6 > 0 and y > O. It also should be clear that as 
+ — 0, the first four charts shown in Figure 16 reduce to the first four 
charts in Figure 6, and the phase portraits shown in Figure 17 reduce to 
the corresponding phase portraits in Figure 5. Note that all of the phase 
portraits shown in Figure 17 occur in chart 5 shown in Figure 16. 


E. THE SURFACE £ =0 


As we cross the plane @ = 0, the bifurcation surfaces H® and HL°® enter 
into the region R; i.e., for B > 0 (and y > 0), the H® and HL® curves do 
not intersect the region 


E = {(a,c) € R? |a> 6+ 27, |c| < 2} 


in the (a,c)-plane; and for G < 0 (and y > 0), they do. Also, for y = 0 
and £ > 0, there is no Takens—Bogdanov curve TB° in the region £ in the 
(a, c)-plane, while for 6 < 0 there is; cf. Problem 8. Figure 18 depicts what 
happens as we cross the plane @ = 0; cf. Problem 9. 

It is instructive at this point to look at some examples of how Theorem 5, 
together with the atlas an charts in [53] can be used to determine the phase 
portrait of a given BQS3 of the form (5). The atlas and charts determine 
which phase portrait in Figure 8 occurs for a specific BQS3 of the form (5), 
provided that we use the algebraic formulas given in Theorem 5 and/or the 
numerical results given in [53] for the various bifurcation surfaces listed 
in Theorem 5. We consider the system (5) with 6 = —10 in the following 
examples because some interesting bifurcations occur for large negative 
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B<0 


Figure 18. The appearance of the H® and HL° curves in the (a, c)-plane 
for B < 0. 


values of 8, and also because we can compare the results for B = —10 
with the asymptotic results given in [51] and in Theorem 6 below for large 
negative @. This is done in Example 4 below. 


Example 2. Consider the system (5) with @ = —10 and y = 3.5. The 
bifurcation curves for 6 = —10 and y = 3.5 are shown in [53] and in 
Figure 19. The bifurcation curves H+, HL*+, H®, HL°®, SS, Cf, and C8 
partition the region a > —3 and |c| < 2 into various components. The 
phase portrait for the system (5) with 6 = —10, 7 = 3.5, and (a,c) in any 
one of these components is determined by Figure 8 above. Note that every 
one of the configurations a—o or a’—o’ in Figure 8 occurs in Figure 19. 

Also note that the multiplicity-two limit cycle bifurcation curve Cf has 
two branches, one of them going from the left-hand point Hf on the curve 
H* to the point HL} on the curve HLt, and the other branch going from 
the right-hand point H} to infinity, asymptotic to the SS curve, as a — 00. 
Cf. the termination principle for one-parameter families of multiple limit 
cycles in [39]. A similar comment holds for the multiplicity-two limit cycle 
bifurcation curve C2? shown in Figure 19. The region of the (a,c)-plane 
containing the two branches of the C} curve is shown on an expanded 
scale in Figure 20. The system (5) with @ = —10, 7 = 3.5, and (a,c) in 
the shaded regions in Figure 20 has two limit cycles around the critical 
point P+; the phase portrait for these parameter values is determined by 
the configuration (k) in Figure 8 above. 

The bifurcation curves HLt+, HL°, Cy, and C9; i.e., the graphs of the 
functions c = h(a, —10,3.5), c = ho(a@, —10,3.5), c = f(a, —10,3.5), and 
c = fo(a, —10,3.5), respectively, were determined numerically. The most 
efficient and accurate way of doing this is to compute the Poincaré map 
P(r) along a ray through the critical point P+ in order to determine the 
HL* and Cf curves (or through the critical point 0 in order to determine 
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+ 


H HL* ¢ 


Figure 19. The bifurcation curves H+, HL+, H®, HL°, SS, Cy, and C9 
for the system (5) with 6 = —10 and y = 3.5. 


the HL® and C8 curves). The displacement function d(r) = P(r)—r divided 
by 7, i.e., d(r)/r, along the ray 0 = 7/6 through the point Pt for the system 
(5) with @ = —10, y = 3.5, and a = 1.1 is shown in Figure 21 for various 
values of c. In Figure 21(a) we see that for a = 1.1, a homoclinic loop occurs 
at c = .04, ie., (1.1,.04---) is a point on the homoclinic loop bifurcation 
curve HL* for @ = —10 and y = 3.5, as shown in Figure 20. Also, the 
displacement function curve d(r)/r shown in Figure 21(a) is tangent to 
the r-axis (which is equivalent to saying that the curve d(r) is tangent 
to the r-axis) at c = .09. The blow-up of some of these curves, given in 
Figure 21(b), shows that the displacement function d(r) is tangent to the 
r-axis at c = .0885; i.e., (1.1, .0885---) is a point on the right-hand branch 
of the multiplicity-two cycle bifurcation curve Cf} for @ = —10 and y = 3.5, 
as shown in Figure 20. It also can be seen in Figure 21(b) that the system 
(5) with 6 = —10, y = 3.5, a = 1.1, and c = .088 has two limit cycles at 
distances r = 4.9 and r = 7.7 along the ray 0 = 7/6 through the critical 
point P+; and for c = .087 there are two limit cycles at distances r & 1.7 
and r = 8.4 along the ray 9 = 7/6 through the critical point Pt. Cf. 
Figure 8(k). 

Figure 22 shows a blow-up of the region in Figure 19 where the curves 
SS, H®, and HL® intersect and where the curve C2 emerges from the 
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HL* ss | He 


Figure 20. The regions in which (5) with 6 = —10 and y = 3.5 has two 
limit cycles around the critical point Pt. 


point H? on the H® curve. The curve C® is tangent to H® at H8, and it is 
asymptotic to the curve HL® as a or c decrease without bound. 


Example 3. Once again consider the system (5) with 6 = —10, but this 
time with y = 3. The bifurcation curves for this case are shown in Figure 23. 
We see that the bifurcation curve CZ only has one branch, which goes from 
the point HL} on the curve HL* to infinity along the SS curve as a — 00. 
The reason why there can be one or two branches of the bifurcation curve 
Cf in the (a, c)-plane for various values of 8 and + is discussed in [53]. Once 
again, the points on the bifurcation curves HL+ and Cj were computed 
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d(r)/r 


sssszeeeRe 


(a) 


d(r)/r 


.O1 


(b) 


Figure 21. The displacement function d(r)/r for the system (5) with 
B= -10, y = 3.5, anda =11.1. 


using the Poincaré map as described in the previous example. The point 
HL} and the bifurcation curves H+, H®, and SS follow from the algebraic 
formulas in Theorem 5. 


We next compare the results of Theorem 5 with the asymptotic results 
in [51], where Li et al. study the unfolding of the center for a BQS given 
in Remark 1 above. They study the system 


£ = —6r-—ayt+y’ 


6 
y = dver + by — zy + dv3y? (6) 
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Figure 22. A blow-up of the region in Figure 12 where SS, H®, and HL° 
cross. 


fora > 0,6 < 0,0 < 6 <1, and |6v3| < 2; cf. equation (1.1) and Theorem C 
in (51]. The system (6) with 6 = 0 is affinely equivalent to the BQS2 with 
a center given in Remark 1. We note that there is a removable parameter 
in the system (6); i.e., for a > 0 the transformation of coordinates t — 
at,x — z/a and y — y/a reduces to (6) to 


= —§r-—yt+y’ (6’) 
y = dvex + by — zy + bvzy” 


with b < 0. For 6 > 0, the linear transformation of coordinates t — dt, x — 
z/6, and y > y/6 transforms (6’) into 


| re 
r= —t— suty 
(6") 


b 2 
y= vox + <y — zy + busy 


with b < 0. Comparing (6’’) to the system (5), we see that they are identical 
with the parameters relayed by 
=—5 a= + bv (7) 
c= 6v3 y= V (v2 — 6)/6 
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Cc 


0 a 


1 


Figure 23. The bifurcation curves H+, HL*+, H®, SS, and cy for the 
system (5) with @ = —10 and y = 3, and the shaded region in which (5) 
has two limit cycles around the critical point Pt. 


for 6 > 0 and v2 > b. Note that the transcritical bifurcation surface ~ = 0 
corresponds to 2 = b in (7). Since the Jacobian of the (nonlinear) trans- 
formation defined by (7), 


O(a, B,7,c) | _ 1 
O(6, V2, 3, b) 7 ov d(v2 = b)’ 


it follows that (7) defines a one-to-one transformation of the region 


{(a, B,7, ¢) € R* | B < 0,7 > 0} 
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onto the region 
{(6, V2, 3,6) € R‘ |6>0,%> b}. 

For 0 < 6 < 1, the asymptotic formulas for the bifurcation surfaces 
H+, H},HL+, HL}, and Cf (denoted by H, Aj, hé, Ag and dé) in [51] can 
be compared to the corresponding bifurcation surfaces in Theorem 5 above 
with 6 = -1/6 < —1. Substituting the parameters defined by (7) into 
Theorem C in [51], or letting G@ — —oo in Theorem 5 above, leads to the 
same asymptotic formulas for the bifurcation surfaces H+, H{, and HL?7. 
These formulas are given in Theorem 6 below. This serves as a nice check on 
our work. In addition, we obtain a bonus from the results in [51]. Namely, 
an asymptotic formula for the bifurcation surface C; this docs not follow 
from Theorem 5, since only the existence of the function f(a, G,-y) is given 
in Theorem 5. This asymptotic formula for C{ follows from the Melnikov 
theory in [51]; cf. Section 4.10. The last statement in Theorem 6 follows 
from the results in [38] and [52]. 


Theorem 6. For 3 = —1/5 « —1 and y? = |G|I? in (5), it follows that 
Ht:c=(1-—T?a+a)6 + 0(67), 


Ht :c= 6 + 0(67), 2a =f? + /T4 = 4/3 + 0(6) forT > 4/3, 
HL}:c =26+0(5),  a=36+0(67), 


and 
Ct: = -26 [202 — a —1+4 (2a? — Wa — 1)? — 1 +0(62) 


as 6 — 0. Furthermore, for each fixed 8 < —1 and y? = |@|[? with T > 

\/4/3, the multiplicity-two limit cycle bifurcation curve Cf is tangent to 
the H+ curve at the point(s) H}, and it has a flat contact with the HLt+ 
curve at the point HLT. 


Remark 3. The result for the homoctinic-loop bifurcation surface H Lt 
given in [51], namely that v2 = 0(6), does not add any significant new 
result to Theorem 5. However, just as Li et al. give the tangent line to Cf 
at HL}; i.e., v3 = —2v2/5+4+0(6), as the linear approximation to HLt 
at HL3 in Figure 1.4 in [51], we also give the linear approximation to H L+ 
at HLT: 


c= —Fa +46 + 0(57) 


as 6 — 0. This is simply the equation of the tangent line to Cf at HLT 
for 8B = —1/5 < —1 and 7? = |A|I?, and it provides a local approximation 
for the bifurcation surface HL+ near HL? for small 6 > 0. It can be 
shown using this linear approximation for HL+ at HL} and the asymptotic 
approximation for H+ and Cy given in Theorem 6 that, for any fixed T > 
(4/3)!/4, the branch of C} from Hf to HL? lies in an 0(5) neighborhood 
of H+ UHL* above H* and HL*. 
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We also obtain the following asymptotic formulas for small 6 > 0 from 
Theorem 5 (where G = —1/6). Note that the first formula for the Hopf 
bifurcation surface H® is exact. 


H®:c=a-—TI?-6, 


1 1 
Hp:¢ = — 75 + 0(5), a=T?— = +0(8), 
SS:c=a—T?+0(6) for a =F? +0(6), 

1 1 
SSO HY:c = —= + 0(6), a =I? — = + 0(6). 


It also follows from Theorem 5 that the surfaces S'S crosses the plane c = 0 
at a = |B|y? =I? for all B < 0. 

Let us compare the results in Examples 2 and 3 above with the asymp- 
totic results given above and in Theorem 6. 


Example 4. Figure 24 shows the bifurcation curves H+, HL*, H®, SS, 
and Cy as well as the points H{ and HL{ on H+ and HL?*, respec- 
tively, given by Theorem 5 for @ = —10 and y = 3.5. Cf. Figure 20. It 
also shows the approximations ~ H*+,~ H°,~ SS, and ~ C} to these 
curves as dashed curves (and the approximation ~ H} to H}) given by 
the asymptotic formulas in Theorem 6 and the above formulas for 8 = —10 
and + = 3.5. The approximation is seen to be reasonably good for this rea- 
sonably large negative value of @ = —10. (For larger negative values of (, 
the approximation is even better, as is to be expected, and as is illustrated 
in Example 5 below.) In Figure 24, we see that the approximation of Ht by 
the asymptotic formula in Theorem 6 is particularly good for 1 < a < 1.5 
but not as good for a near zero; however, the difference between the H* 
and ~ H+ curves at a = 0,.04 = 0(67) for 6 = —1/G =.1 in this case. 

Figure 25 shows the same type of comparison for 3 = —10 and y = 3. We 
note that both Cf N H+ = @ and (~ C})N (~ H*) =9; ie., there are no 
Hy nor ~ Hf} points on H* or ~ H*, respectively. Thus, the asymptotic 
formulas in Theorem 6 also yield some qualitative information about the 
bifurcation curves H+ and C} for B « —1. 


Example 5. We give one last example to show just how good the asymp- 
totic approximations in Theorem 6 are for large negative 3. We consider 
the case with @ = —100 and y = 12, in which case [ = 6y? = 1.44 > ¢/4/3 
and, according to the asymptotic formula in Theorem 6 for Hj, there will 
be two points Ht on the curve H*. Since the bifurcation curves given by 
Theorem 5 and their usymptotic approximations given by Theorem 6 (and 
the formulas following Theorem 6) are so close, especially for .3 < a < 2, we 
first show just the approximations ~ H*+,~ C{,~ SS,~ H®, and ~ H? in 
Figure 26. These same curves are shown as dashed curves in Figure 27 along 
with the exact bifurcation curves given by Theorem 5. The comparison is 
seen to be excellent. In particular, H+ and ~ H* as well as H® and ~ H®, 
and SS and ~ SS are indistinguishable (on this scale) for .3 < a < 2. For 
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el 


HL* 


Figure 24. A comparison of the bifurcation curves given by Theorem 5 
with their asymptotic approximations given by Theorem 6 for 6 = —10 
and + = 3.5. 


a near zero, the approximation of H+ by ~ Ht? is within .0003 = 0(6?) for 
6 = —1/f8 = 1/100 in this case. One final comment: In Figures 26 and 27, 
we sce that there is a portion of ~ Cy between the two points ~ Ht on 
~ H+. However, this portion of ~ C} (for T > ¢/4/3) has no counterpart 
on Cj , since dynamics tells us that there are no limit cycles for parameter 
values in the region above H* in this case. Cf. Remark 10 in [38]. 


We end this section with a theorem summarizing the solution of Coppel’s 
problem for BQS, as stated in the introduction, modulo the solution to 
Hilbert’s 16th problem for BQS3: 
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Figure 25. A comparison of the bifurcation curves given by Theorem 5 
with their asymptotic approximations given by Theorem 6 for B = —10 


and y = 3. 


Theorem 7. Under the assumption that any BQS3 has at most two limit 
cycles, the phase portrait of any BQS is determined by one of the configura- 
tions in Figures 1, 2, 5, or 8. Furthermore, any BQS is affinely equivalent 
to one of the systems (1)-(5) with the algebraic inequalities on the coef- 
ficients given in Theorem 2 or 3 or in Lemma 1 or 2, the specific phase 
portrait that occurs for any one of these systems being determined by the 
algebraic inequalities given in Theorem 2 or 3, or by the partition of the 
regions in Theorem 4 or 5 described by the analytic inequalities defined by 
the charts in Figure 6 or by the atlas and charts in Figures A and C in 
[53], which are shown in Figures 15 and 16 for B > 0. 
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~SS, ~H° 


~-H* 


01 


0 1 a 


Figure 26. The asymptotic approximations for the bifurcation curves 
H+, H°,SS, and C} given by Theorem 6 for 8 = —100 and ¥ = 12. 


Corollary 1. There is a BQS with two limit cycles in the (1,1) configu- 
ration, and, under the assumption that any BQS3 has at most two limit 
cycles, the phase portrait for any BQS with two limit cycles in the (1,1) 
configuration is determined by the separatriz configuration in Figure 8(n). 


Corollary 2. There is a BQS with two limit cycles in the (2,0) configu- 
ration, and, under the assumption that any BQS3 has at most two limit 
cycles, the phase portrait for any BQS with two limit cycles in the (2,0) 
configuration is determined by the separatriz configuration in Figure 8(k). 


Remark 4. The termination of any one-parameter family of multiplicity- 
m limit cycles of a planar, analytic system is described by the termination 
principle in [39]. We note that, as predicted by the above-mentioned termi- 
nation principle, the one-parameter families of simple or multiplicity-two 
limit cycles whose existence is established by Theorem 5 (several of which 
are exhibited in Examples 2-5) terminate cither 


(i) as the parameter or the limit cycles become unbounded, or 
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~Ht 


Figure 27. A comparison of the bifurcation curves given by Theorems 5 
and 6 for G = —100 and y = 12. 


(ii) at a critical point in a Hopf bifurcation of order k = 1 or 2, or 


(iii) on a graphic or separatrix cycle in a homoclinic loop bifurcation of 
order k = 1 or 2, or 


(iv) at a degenerate critical point (i.e., a cusp) in a Takens—-Bogdanov 
bifurcation. 


PROBLEM SET 14 
In this problem set, the student is asked to determine the bifurcations that 
occur in the BQS2 or BQS3 given by 


f= —-r+PByty’ 


y = az — (a8 + 7’)y — zy +c(-2 + By + y’) (5) 


with a — B > 2y > 0; cf. Lemmas 1 and 2. According to Lemma 2, the 
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critical points of (5) are at 0 = (0,0) and P+ = (z+, y+) with 


x* = (8 +y*)y* 


+ _ a-~ B+ V(a— 8)? — 4° . 
y~ = 5 (8) 


If we let f(x,y) denote the vector field defined by the right-hand side of 
(5), it follows that 


and 


—1 
Df£(0,0) = asa cee alll? 
and that 
+ jt) _ a abd | 
Df(z*,y*) = b cucal B(c — a) + (2c — a)y* 


—1 atS 
= lerpmters e=ola A) ela A) 4-8 
2 2 
where S = \/(a — £)? — 472. 
If we use 6(z, y) for the determinant and 7(z, y) for the trace of Df(z, y), 
then it follows from the above formulas that 


6(0,0) = det Df(0,0) = y? > 0, 
7(0,0) = tr Df(0,0) = -1+ cB —aB-7’, 
6(x*,y*) = det Df(x*,y*) = +Sy*, 


and 
7(x*,y*) = tr Df(z*,y*) = -1+ B(c — a) + (2c — a)y*. 


These formulas will be used throughout this problem set in deriving the 
formulas for the bifurcation surfaces listed in Theorem 5 (which reduce to 
those in Theorem 4 for 7 = 0). 


1. (a) Show that for a # 6+2y there is a Hopf bifurcation at the criti- 
cal point Pt of (5) for parameter values on the Hopf bifurcation 
surface 

_ 1lta(at+Bht+$)/2 

7 at+S 

where S = ,/(a — ZB)? — 47? and that, for y = 0 and a > @ as 


in Lemma 1, this reduces to the Hopf bifurcation surface for (4) 
given by 


Ht:c 


? 


1+a? 
2a — 8 


Ht:c= 
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Furthermore, using formula (3’) in Section 4.4, show that for 
points on the surface H+, Pt is a stable weak focus (of multi- 
plicity one) of the system (4), and that a supercritical Hopf bi- 
furcation occurs at points on H* as c increases. Cf. Theorem 5’ 
in Section 4.15. 


Use equation (3’) in Section 4.4 and the fact that a BQS3 cannot 
have a weak focus of multiplicity m > 3 proved in [50] to show 
that the system (5) has a weak focus of multiplicity two at P* for 
parameter values (a, 3,7,c) € Ht that lie on the multiplicity- 
two Hopf bifurcation surface 


—b + Jb? — 4ad 
2a ; 


(b 


~~ 


oe 
Hz :_cC= 


where a = 2(2S — B),b = (a+ B — S)(G — 2S) + 2, and d = 
B—a-—3S with S given above. Note that the quantity o, given 
by equation (3’) in Section 4.4, determines whether we have a su- 
percritical or a subcritical Hopf bifurcation, and that o changes 
sign at points on Hj; cf. Figure 20. Cf. Theorem 6’ in Sec- 
tion 4.15. 


2. Show that there is a Takens—-Bogdanov bifurcation at the origin of the 
system (5) for parameter values on the Takens-Bogdanov bifurcation 
surface ; 

TBic=a+G and 7 =0 
for a # GB; cf. Theorems 3 and 4 in Section 4.15. Note that the system 
(5) reduces to the system (4) for + = 0. Also, cf. Problem 8 below. 


3. Note that for a = 3 + 27, the quantity S = (a — 6)? — 47? = 0. 
This implies that r+ = z~ and yt = y7; i.e., as a > B+ 27, Pt 
P-. Show that for a = B + 27, 6(x*, y+) = 0 and r(x*, y*) £ 0 if 
c#1/(8+ 27) + 6+; i.e., Df(x*, y*) has one zero eigenvalue in 
this case. Check that the conditions of Theorem 1 in Section 4.2 are 
satisfied, i.e, show that the system (5) has a saddle-node bifurcation 
surface given by 

SN:a = B+ 24. 
Cf. Theorem 1’ and Problem 1 in Section 4.15. Note that this equation 
reduces to a = @ for the system (4), where ~ = 0 and as Theorem 2 
in the next section shows, in this case we have a saddle-node or cusp 
bifurcation of codimension two. 


4, Show that for a = G6 + 2y and c= 1/(8 + 27) + 8 +7, the matrix 
-l a 
A = Df(z*,y*) = | | | 


== 
a 
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and that 6(r+, y+) = r(z+, y+) = 0, where, as was noted in Prob- 
lem 3, (zt, y* — (x~,y~) for a = B+ 24. Since the matrix A # 0 
has two zero eigenvalues in this case, it follows from the results in 
Section 4.13 that the quadratic system (5) experiences a Takens- 
Bogdanov bifurcation for parameter values on the Takens-Bogdanov 
surface 


1 
TBt:c= rae eae and a=£+2y 


for y # 0: cf. Theorems 3’ and 4’ in Section 4.15. Note that it was 
shown earlier in this section that for the TB* points to lie in the 
region |c| < 2, it was necessary that the point (3,7) lie in the region 
between the curves Tz in Figure 10; this implies that 3 + 2y > 0, 
i.e., that a > O in this case. It should also be noted that a codi- 
mension two Takens-Bogdanov bifurcation occurs at points on the 
above TBt curve for y 4 —(@? + 2)/28; however, for 3 < 0 and 
+ = —(G? + 2)/2@, a codimension three Takens-Bogdanov bifurca- 
tion occurs on the TBt curve defined above. Cf. the remark at the 
end of Section 4.13, reference [46] and Theorem 4’ in the next section. 
Also, it can be shown that there are no codimension four bifurcations 
that occur in the class of bounded quadratic systems. 


. Similar to what was done in Problem 1, for y # 0 and 2 # O set 


7(0,0) = 0 to find the Hopf bifurcation surface 


1+7? 
B 


for the critical point at the origin of (5). Cf. Theorem 5 in Section 4.15. 
Then, using equation (3’) in Section 4.4 and the result in (50] cited 
in Problem 1, show that for parameter values on H® and on 


¢) —b+ Vb? — 4ad 
H3:¢c = ———————_——_ 
: 2a 


with b = 1+ 2a” — afZ,a = 8B — 2a, and d = a — @, the system 
(5) has a multiplicity-two weak focus at the origin. Cf. Theorem 6 in 
Section 4.15. 


H®:c=a+t 


. Use the fact that the system (5) forms a semi-complete family of 


rotated vector fields mod z = Gy + y* with parameter c € R and 
the results of the rotated vector field theory in Section 4.6 to show 
that there exists a function h(a,G,7) defining the homoclinic-loop 


bifurcation surface 
HLt:c = h(a, 3. 7), 


for which the system (5) has a homoclinic loop at the saddle point P~ 
that encloses P+. This is exactly the same procedure that was used 
in Section 4.13 in establishing the existence of the homoclinic-loop 
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bifurcation surface for the system (2) in that section. The analyticity 
of the function h(a. G,-y) follows from the results in [38]. Carry out 
a similar analysis, based on the rotated vector field theory in Sec- 
tion 4.6, to establish the existence (and analyticity) of the surfaces 
HL°, Cy, and C9. Remark 10 in [38] is helpful in establishing the ex- 
istence of the C? and C9 surfaces, and their analyticity also follows 
from the results in [38]. Cf. Remarks 2 and 3 in Section 4.15. 


7. Use Theorem 1 and Remark 1 in Section 4.8 to show that for points on 
the surface HL*, the system (5) has a multiplicity-two homoclinic- 
loop bifurcation surface given by 


Hie= ale ee 


with S given above. Note that under the assumption that (5) has at 
most two limit cycles, there can be no higher multiplicity homoclinic 
loops. 


8. Note that as 7 — 0, the critical point P~ — 0. Show that for 7 = 
0.6(0.0) = O and that 7(0,0) # 0 for c # 1/8 + a: i.e., Df(0,0) 
has one zero eigenvalue in this case. Check that the conditions in 
equation (3) in Section 4.2 are satisfied in this case, i.e., show that 
the system (5) has a transcritical bifurcation for parameter values on 
the transcritical bifurcation surface 


1C:4 =: 


Figure 28. The Takens-Bogdanov bifurcation surface TB®° = H® N HL® 
© TC in the (a,c)-plane for a fixed B < 0. 


528 4. Nonlinear Systems: Bifurcation Theory 


Note that the H® and HL? surfaces intersect in a cusp on the 7 = 0 
plane as is shown in Figure 28. 


9. Re-draw the charts in Figure 16 for -1 < 8 < 0. Hint: As in Fig- 
ure 18, the HL® and H® curves enter the region E for 8 < 0, and for 
points on the HL® curve we have the phase portrait (f’) in Figure 8, 
etc. 


4.15 Finite Codimension Bifurcations in the Class 
of Bounded Quadratic Systems 


In this final section of the book, we consider the finite codimension bifur- 
cations that occur in the class of bounded quadratic systems (BQS), i.c., 
in the BQS (5) in Section 4.14: 


= -r+fhyty’ 


y = ar—(af+7*)y-—zy+c(-r + Byt+y’) O) 


with a > B+ 27,7 > 0 and |c| < 2. As in Lemma 2 of Section 4.14, 
the system (1) defines a one-parameter family of rotated vector fields mod 
xz = By +y? with parameter c and it has three critical points 0, P+ with a 
saddle at P~ and nodes or foci at 0 and P*. The coordinates (r+, y*) of 
P+ are given in Lemma 2 of Section 4.14. 

We consider saddle-node bifurcations at critical points with a single- 
zero cigenvaluc, Takens—Bogdanov bifurcations at a critical point with a 
double-zero eigenvalue, and Hopf or Hopf-Takens bifurcations at a weak 
focus. Unfortunately, there is no universally accepted terminology for nam- 
ing bifurcations. Consequently, the saddle-node bifurcation of codimension 
two referred to in Theorem 3.4 in [60], i-e., in Theorem 2 below, is also 
called a cusp bifurcation of codimension two in Section 4.3 of this book 
and in (G/S]; however, once the codimension of the bifurcation is given 
and the bifurcation diagram is described, the bifurcation is uniquely deter- 
mined and no confusion should arise concerning what bifurcation is taking 
place, no matter what name is used to label the bifurcation. 

In this section we sce that the only finite-codimension bifurcations that 
occur at a critical point of a BQS are the saddle-node (SN) bifurcations 
of codimension 1 and 2, the Takens—Bogdanov (TB) bifurcations of codi- 
mension 2 and 3, and the Hopf (H) or Hopf-Takens bifurcations of codi- 
mension 1 and 2 and that whenever one of these bifurcations occurs at a 
critical point of the BQS (1), a universal unfolding of the vector field (1) 
exists in the class of BQS. We use a subscript on the label of a bifurcation 
to denote its codimension and a superscript to denote the critical point at 
which it occurs: for example, SN2 will denote a codimension-2, saddle-node 
bifurcation at the origin, as in Theorem 2 below. 
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Most of the results in this section are established in the recent work 
of Dumortier, Herssens and the author [60]. This section, along with the 
work in [60], serves as a nice application of the bifurcation theory, normal 
form theory, and center-manifold theory presented earlier in this book. In 
presenting the results in [60], we use the definition of the codimension of a 
critical point given in Definition 3.1.7 on p. 295 in [Wi-II]. The codimension 
of a critical point measures the degree of degeneracy of the critical point. 
For example, the saddle-node at the origin of the system in Example 4 of 
Section 4.2 for » = 0 has codimension 1, the node at the origin of the 
system in Example 1 in Section 4.3 has codimension 2 and the cusp at 
the origin of the system (1) in Section 4.13 has codimension 2. We begin 
this section with the results for the single-zero-eigenvalue or saddle-node 
bifurcations that occur in the BQS (1). 


A. SADDLE-NODE BIFURCATIONS 


First of all, note that as  — 0 in the system (1), the critical point P~ — 0 
and the linear part of (1) at (0,0) has a single-zero eigenvalue for B(c—a) # 
1; cf. Problem 1. The next theorem, which is Theorem 3.2 in [60], describes 
the codimension-1, saddle-node bifurcation that occurs at the origin of the 
system (1). 


Theorem 1 (SN?)). For y = 0,a # B and B(c — a) # 1, the system (1) 
has a saddle-node of codimension 1 at the origin and 


—2+By+y? 
y = ptazr—afy—zy+c(-z + By + y”) 


x 


(2) 


is a universal unfolding of (1), in the class of BQS for |c| < 2, which has a 
saddle-node bifurcation of codimension 1 at p = 0. The bifurcation diagram 
for this bifurcation is given by Figure 2 in Section 4.2. 


The proofs of all of the theorems in this section follow the same pattern: 
We reduce the system (1) to normal form, determine the resulting flow 
on the center manifold, and use known results to deduce the appropriate 
universal unfolding of this flow. We illustrate these ideas by outlining the 
proof of Theorem 1. Cf. the proof of Theorem 3.2 in [60]. 

The system (1) under the linear transformation of coordinates 


z=u+t Bu 
y=(c—a)ut+y, 


which reduces the linear part of (1) at the origin to its Jordan normal form, 
becomes 


u+ Qoou? + a),uUv + agou" 
v= boou? + b), uv + bog” 


(3) 
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where a29 = (a — c)(aBc — a + B — Bc? + c)/[B(c — a) — 1]?,...,bo2 = 
(B — a)/[B(c — a) — 1]?, cf. Problem 2 or [60], and where we have also let 
t — [G(c — a) — 1]t. On the center manifold, 


u = —aggu” + 0(v°), 
of (3) we have a flow defined by 
0 = bogv” + 0(v") 


with bo2 # 0 since a # G. Thus, there is a saddle-node (of codimension 1) 
at the origin of (3). Furthermore, the system obtained from (2) under the 
above linear transformation of coordinates, together with t + —[6(c—a) — 
1]?t, has a flow on its center manifold defined by 


b= pt (B—a)v? +0(v, 09, p?,...). (4) 


As in Section 4.3, the 0(v) terms can be eliminated by translating the origin 
and, as in equation (4) in Section 4.3, we see that the above differential 
equation is a universal unfolding of the corresponding normal form (4) with 
p. = 0; ie., the system (2) is a universal unfolding of the system (1) in this 
case. Furthermore, by translating the origin to the O(j) critical point of 
(2), the system (2) can be put into the form of system (1) which is a BQS 
for |c| < 2. 


Remark 1. The unfolding (2), with parameter yz, of the system (1) with 
7 = 0,a # B and B(c—a) # 1, gives us the generic saddle-node, codimension- 
1 bifurcation described in Sotomayor’s Theorem 1 in Section 4.2 (Cf. Prob- 
lem 1), while the unfolding (1) with parameter +y gives us the transcritical 
bifurcation, labeled TC in Section 4.14. 

We next note that as a — £6 + 2y in the system (1), the critical point 
P- — Pt and the linear part of (1) at P* has a single-zero eigenvalue for 
c#B+7+1/(8 + 24); cf. Problem 3 in Section 4.14. The next theorem 
gives the result corresponding to Theorem 1 for the codimension-1, saddle- 
node bifurcation that occurs at the critical point P* of the system (1). 
This bifurcation was labeled SN in Section 4.14. 


Theorem 1' (SN;}*). For a = B+ 27,7 #0 and (8+ 2y)(c—-a+t+y) #1, 
the system (1) has a saddle-node of codimension 1 at P+ = (xt, yt) and 


z= —2+Pyt+y’ 
y = p+ (B+ 2y)2 — (6 4+7)?y -— zy +c(-2 + By + y’) 


is a universal unfolding of (1), in the class of BQS for |c| < 2, which has a 
saddle-node bifurcation of codimension 1 at 1 = 0. The bifurcation diagram 
for this bifurcation is given by Figure 2 in Section 4.2 


(5) 


If both 7 — 0 and a > 6 + 27 in (1), then both P* — 0 and the linear 
part of (1) still has a single-zero eigenvalue for B(c— a) # 1; cf. Problem 1. 
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The next theorem, which is Theorem 3.4 in [60], cf. Remark 3.5 in [60], 
describes the codimension-2, saddle-node bifurcation that occurs at the 
origin of the system (1) which, according to the center manifold reduction 
in [60], is a node of codimension 2. The fact that (6) below is a BQS for 
|c| < 2 follows, as in [60], by showing that (6) has a saddle-node at infinity. 


Theorem 2 (SN). For y = 0,a = B and B(c — a) # 1, the system (1) 
has a node of codimension 2 at the origin and 

z= —-2+Byt+y’ 

y = pn t+ Bx — (6? + yo)y — zy +c(-2 + By + y*) 
is a universal unfolding of (1), in the class of BQS for |c| < 2, which 


has a saddle-node (or cusp) bifurcation of codimension 2 at 4 = 0. The 
bifurcation diagram for this bifurcation is given by Figure 2 in Section 4.3. 


(6) 


In the proof of Theorem 2, or of Theorem 3.4 in [60], we use a center 
manifold reduction to show that the system (1), under the conditions listed 
in Theorem 2, reduces to the normal form (5) in Section 4.3 whose universal 
unfolding is given by (6) in Section 4.3, i.e., by (6) above; cf. Problem 2. 


B. TAKENS—BOGDANOV BIFURCATIONS 


As in paragraph A above, as y — 0,P~ — 0; however, the linear part 
of (1) at the origin has a double-zero eigenvalue for B(c — a) = 1; ef. 
Problem 1. The next theorem, which follows from Theorem 3.8 in [60], 
describes the codimension-2, Takens—Bogdanov bifurcation that occurs at 
the origin of the system (1) which, according to the results in [60], is a cusp 
of codimension 2. The fact that the system (7) below is a BQS for |c| < 2 
and p2 ~ 0 follows, as in [60], by looking at the behavior of (7) on the 
equator of the Poincaré sphere where there is a saddle-node. 


Theorem 3 (TB). For y = 0, a # B, B(c— a) = 1 and B F 2c, the 
system (1) has a cusp of codimension 2 at the origin and 


t= -2+fyty’ 


7 
Y = pi tax — (a8 + pe)y—ryt+c(-—r + By ty’) 7) 


is a universal unfolding of (1), in the class of BQS for |c| < 2 and po ~ 0, 
which has a Takens-Bogdanov bifurcation of codimension 2 at 4 = 0. The 
bifurcation diagram for this bifurcation is given by Figure 3 in Section 4.13. 


In the proof of Theorem 3, or of Theorem 3.8 in [60], we show that 
the system (1), under the conditions listed in Theorem 3, reduces to the 
normal form (1) in Section 4.13 whose universal unfolding is given by (2) 
in Section 4.13, i.e., by (7) above; cf. Problem 3. 
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The next theorem gives the result corresponding to Theorem 3 for the 
codimension-2, Takens-Bogdanov bifurcation that occurs at the critical 
point Pt of the system (1). 


Theorem 3’ (TB). For a = B + 27, 7 #0, (8+2y7)(c—a+v7) =1 and 
B27 +2By+2 40, the system (1) has a cusp of codimension 2 at the critical 
point P* and 


t= —-z+pyty’ 
y = n+ (B+ 2y)r + [(B +7)? + wely — cy + c(—2z + By + y”) 


is a universal unfolding of (1), in the class of BQS for |c| < 2 and p2 ~ 0, 
which has a Takens-Bogdanov bifurcation of codimension 2 at up = 0. The 
bifurcation diagram for this bifurcation is given by Figure 3 in Section 4.13. 


(8) 


The next theorem, which follows from Theorem 3.9 in [60], describes 
the codimension-3, Takens-Bogdanov bifurcation that occurs at the origin 
of the system (1), which, according to the results in [61], is a cusp of 
codimension 3; cf. Remarks 1 and 2 in Section 2.13. The fact that the 
system (9) below is a BQS for |c| < 2, 42 ~ 0 and p3 ~ 0, follows as in [60], 
by showing that (9) has a saddle-node at infinity. 


Theorem 4 (TB). For y = 0, a # B, B(c— a) = 1 and B = 2c, the 
system (1) has a cusp of codimension 3 at the origin and 


z= —-r+Byt+y’? 
Y = pr tax — (af + pe)y — (1+ us)zy + c(—x + By + y*) 


is a universal unfolding of (1), in the class of BQS for |c| < 2,py2~ 0 
and p3 ~ 0, which has a Takens-Bogdanov bifurcation of codimension 3 at 
pp = 0. The bifurcation diagram for this bifurcation is given by Figure 1 
below. 

In proving this theorem, we show that the system (1), under the condi- 
tions listed in Theorem 4, reduces to the normal form (9) in Section 4.13 
whose universal unfolding is given by (10) in Section 4.13, i.e. by (9) above; 
cf. [46] and the proof of Theorem 3.9 in [60]. 

The next theorem describes the Takens—Bogdanov bifurcation TB} that 
occurs at the critical point P+ of the system (1). 


Theorem 4’ (TB3). For a = B+ 27, 7 #0, (8+ 27)(c_a+~7) =1 and 
32 +2B7+2 =0, the system (1) has a cusp of codimension 3 at the critical 
point P* and 


(9) 


z= —-r+Byt+y? 
Y = 11 + (B+ 2y7)r + [(B +7)? + waly - (1 i lee dials 


is a universal unfolding of (1), in the class of BQS for |c| < 2, w2 ~ 0 
and pi3 ~ 0, which has a Takens-Bogdanov bifurcation of codimension 3 at 
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Figure 1. The bifurcation set and the corresponding phase portraits for the 
codimension-3 Takens—Bogdanov bifurcation (where s and u denote stable 
and unstable limit cycles or separatrix cycles respectively). 


pp = 0. The bifurcation diagram for this bifurcation is described in Figure 1 
above. 


It was shown in [46] and in [61] that the bifurcation diagram for the 
system (9), which has a Takens-Bogdanov bifurcation of codimension 3 
at ys = 0, is a cone with its vertex at the origin of the three-dimensional 
parameter space (1), 2, 43). The intersection of this cone with any small 
sphere centered at the origin can be projected on the plane and, as in (46] 
and (61], this results in the bifurcation diagram (or bifurcation set) for the 
system (9) or for the system (10) shown in Figure 1 above. The bifurcation 
diagram in a neighborhood of either of the TB. points is shown in detail 
in Figure 3 of Section 4.13. The Hopf and homoclinic-loop bifurcations of 
codimension 1 and 2, H,, H2,HL,, and HI» were defined in Theorem 5 
in Section 4.14 and are discussed further in the next paragraph. Also, in 
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Figure 1 we have deleted the superscripts on the labels for the bifurcations 
since Figure 1 applies to either (9) or (10). 


C. HOPF OR HOPF-TAKENS BIFURCATIONS 


As in Problem 5 in Section 4.14, the system (1) has a weak focus of mul- 
tiplicity 1 (or of codimension 1) at the origin if c = a + (1+ 7)/6 and 
c # h&(a, 3) where 


12(c, 8) = [ap—2a? ~ 14 (ap—202—1)? -4(a—A)(6—2a)| (26-4), 


The next theorem follows from Theorem 3.16 in [60]. 


Theorem 5 (H°). For y #0, 8 #0, c=a+(1+~77)/f andc # h(a, A), 
the system (1) has a weak focus of codimension 1 at the origin and the 
rotated vector field 


t= -r+fhyt+y’ 

y = az — (a8 + 7)y — zy + (c+ u)(—2 + By + y’) 
with parameter p € R is a universal unfolding of (1), in the class of BOS 
for |c| < 2 and »p ~ 0, which has a Hopf bifurcation of codimension 1 at 


p= 0. The bifurcation diagram for this bifurcation is given by Figure 2 in 
Section 4.4. 


(11) 


The idea of the proof of Theorem 5 is that under the above conditions, 
the system (1) can be brought into the normal form in Problem 1(b) in 
Section 4.4 and, as in Theorem 5 and Problem 1(b) in Section 4.6, a rotation 
of the vector field then serves as a universal unfolding of the system. In [60] 
we used the normal form for a weak focus of a BQS given in [50] together 
with a rotation of the vector field to obtain a universal unfolding. 

The next theorem treats the Hopf bifurcation at the critical point Pt 
and, as in Theorem 5 or Problem 1 in Section 4.14, we define the function 
ht (a, B,y) = (-b+ Vb? — 4ad) /2a with a = 2(2S—),b = (a+ B—S)(B- 
2S) +2,d = B-—a-—3S and S = (a — B)? — 47’. 


Theorem 5’ (Hj). For a 4 B+ 27, B? — 208 — 47? £0, c= [1 +a(a+ 
B + S)/2)/(a+S) andc# hf (a, B,7), the system (1) has a weak focus of 
codimension 1 at P* and the rotated vector field (11) with parameter p € R 
is a universal unfolding of (1), in the class of BQS for |c| < 2 andy ~O, 
which has a Hopf bifurcation of codimension 1 at p = 0. The bifurcation 
diagram for this bifurcation is given by Figure 2 in Section 4.4. 


The next theorem, describing the Hopf-Takens bifurcation of codimen- 
sion 2 that occurs at the origin of the system (1) follows from Theorem 3.20 
in (60]. The details of the proof of that theorem are beyond the scope of 
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Hy 


H2 


IS 
aa, 
GSLLL 
VAP PA ALL 
B2 


Figure 2. The bifurcation diagram and the bifurcation set (in the py, po 
plane) for the codimension-2 Hopf-Takens bifurcation. Note that at 
/4) = f2 = O the phase portrait has an unstable focus (and no limit cycles) 
according to Theorem 4 in Section 4.4. Cf. Figure 6.1 in [G/S]. 
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this book; however, after reducing the system (12) to the normal form for a 
BQS with a weak focus in [50], we can use Theorem 4 in Section 4.4 and the 
theory of rotated vector fields in Section 4.6 to analyze the codimension-2, 
Hopf- Takens bifurcation and draw the corresponding bifurcation set shown 
in Figure 2 above. Cf. Problem 4. The fact that (12) is a universal unfolding 
for the Hopf-Takens bifurcation of codimension 2 follows from the results 
of Kuznetsov [64], as in (60]; cf. Remark 4 below. The results for the Hopf 
Takens bifurcation of codimension-2 that occurs at the critical point P* of 
the systein (1) are given in Theorem 6! below. Recall that it follows froin 
the results in [50] that a BQS cannot have a weak focus of multiplicity (or 
codimension) greater than two. 


Theorem 6 (H2). For 7 #0. 4 0,c =a+(1+77)/8 andc = h3(a, 3), 
the system (1) has a weak focus of codimension 2 at the origin and 


& = -r+Byt+y? 


12 
y=ar—(afst 47 )y — (1+ po)ry + (c + pr )(-2 + By + y?) a2) 


is a universal unfolding of (1). in the class of BQS for |c| < 2. xy ~ 0 and 
[tg ~ 0, which has a Hopf-Takens bifurcation of codimension 2 at = 0. 
The bifurcation diagram for this bifurcation is given by Figure 2 above. 


Theorem 6! (Hj). For a # 3 + 27. 8? — 208 — 47? #0, «= [l+a(at 
3+ S)/2|/(a +S) and c = hj (a. 3.7). the system (1) has a weak focus of 
codimension 2 at P* and the system (12) is a universal unfolding of (1). in 
the class of BQS for |c| < 2, xy ~ 0. and jig ~ 0, which has a Hopf- Takens 
bifurcation of codimension 2 at = 0. The bifurcation diagram for this 
bifurcation is given by Figure 2 above. 


We conclude this section with a few remarks concerning the other finite- 
codimension bifurcations that occur in the class of BQS. 


Remark 2. It follows from Theorem 6 above and the theory of rotated 
vector fields that there exist multiplicity-2 limit cycles in the class of BQS. 
(This also follows as in Theorem 5 and Problem 6 in Section 4.14.) The 
BQS (1) with parameter values on the multiplicity-2 limit cycle bifurcation 
surfaces C2 or Cy in Theorem 5 of Section 4.14 has a universal unfolding 
given by the rotated vector field (11). in the class of BQS for |c| < 2 
and ye ~ 0, which. in either of these cases, has a codimension-1, saddle- 
node bifurcation at a semi-stable limit cycle (as described in Theorem 1 of 
Section 4.5) at 2 = 0. The bifurcation diagram for this bifurcation is given 
by Figure 2 in Section 4.5. 


Remark 3. As in Theorem 5 in Section 4.14, there exist homoclinic loops 
of inultiplicity 1 and also homoclinic loops of multiplicity 2 in the class of 
BQS. And under the assumption that any BQS has at most two limit cycles, 
there are no homoclinic loops of higher codimension; however, Hilbert’s 
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16th Problein for the class of BQS is still an open problem; cf. Research 
Problem 2 below. The BQS (1) with parameter values on the homoclinic- 
loop bifurcation surfaces HL° and HL* (or on the SS bifurcation surface) 
in Theorei 5 of Section 4.14 has a universal unfolding given by the rotated 
vector field (11). in the class of BQS for |c| < 2 and yx ~ 0, which in 
either of these cases has a homoclinic-loop bifurcation of codimension 1 
at 4: = 0. For parameter values on the bifurcation surface HL+ Q HLJ in 
Theorem 5 of Section 4.14, it is conjectured that the BQS (1) has a nniversal 
unfolding given by the system (12). in the class of BQS for |c] < 2.4, ~ 0 
and jt2 ~ 0, which has a homoclinic-loop bifurcation of codimension 2 at 
pe = 0, the bifurcation diagram being given by Figure 8 (or Figure 10) 
in [38]: cf. Theorem 3 and Remark 10 in [38]. Also. cf. Figure 1 above, 
Figure 20 in Section 4.14 and Figure 7 (or Figure 12) in [38]. Finally, 
for parameter values on the homoclinic-loop bifurcation surface HL+t (or 
on the SS bifurcation surface) in Theorem 4 in Section 4.14. which has a 
saddle-node at the origin. it is conjectured that the BQS (1) has a universal 
unfolding given by a rotation of the vector field (1), as in eqnation (11), 
together with the addition of a parameter jz), as in equation (7), to unfold 
the saddle node at. the origin; this will result in a codimension-2 bifurcation 
which splits both the saddle-node and the homoclinic loop (or saddle-saddle 
connection). 


Remark 4. In this section we have considered the finite codimension bi- 
furcations that occur in the class of bounded quadratic systems. In this 
context, it is worth citing some recent results regarding two of the higher 
codimension bifurcations that occur at critical points of planar systems: 


A. The single-zero eigenvalue or saddle node bifurcation of codimension m. 
SNm: In this case, the planar system can be put into the normal form 


r= peti 4 O(|x|""*?) 
y= —y + O(|x|"**) 


and a universal unfolding of this normal form is given by 


wml m+ 


LoS fly + fot te++ + me —w 
y=-y. 
cf. Section 4.3. 


B. A pair of pure imaginary cigenvalues, the Hopf-Takens bifurcation of 
codimension m, H,,: It has recently been shown by Kuznetsov [64] that 
any planar C!-system 

x = f(x, 11) (13) 
which has a weak focus of multiplicity one at the origin for 4 = 0, with 
the eigenvalues of Df(x,,, 4) crossing the imaginary axis at 44 = 0, can be 
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transformed into the normal form in Theorem 2 in Section 4.4 with b = 0 
and a = +1 by smooth invertible coordinate and parameter transforma- 
tions and a reparameterization of time, a universal unfolding of that normal 
forin being given by the universal nnfolding in Theorem 2 in Section 4.4 
with 6 = 0 and a = +1 (the plus sign corresponding to a subcritical Hopf 
bifurcation and the minus sign corresponding to a supercritical Hopf bifur- 
cation). Furthermore, Kuznetsov [64] showed that any planar C'-system 
(13) which has a weak focus of multiplicity two at the origin for = 0 and 
which satisfies certain regularity conditions can be transformed into the 
following normal form with gz = 0 which has a universal unfolding given 
by 

d= pe — y + ptoa|x|? + z|x|" + O(|x]®) 

y= xt pry + poylx|? + y|x|* + O(|x]°). 
Finally, it is conjectured that any planar C'-system (13) which has a weak 
focus of multiplicity m at the origin for zg = 0 and which. satisfies certain 
regularity conditions can be transformed into the following normal form 
with ge = O which has a universal unfolding given by 


r= pyxr-—yt jto|x|? ie «sake Hm tfx|20r—) 4 |x|?" re O(|x|20" +) 
P= e+ ery + paylx|? +--+ + pyl|?O"—Y & yx?" + O(fx[?O"*). 


PROBLEM SET 15 


1. Show that as 7 — 0 the critical point P~ of (1) approaches the origin, 
that 6(0,0) = 0 and that 7(0,0) = -—1+ @(c¢ — a). Cf. the formulas 
for 6 and 7 in Problem Set 14. Also, show that the conditions of 
Sotomayor’s Theorem 1 in Section 4.2 are satisfied by the systeimn 
(2) for (ec -a)B # l.a # BZ and y = 0 and by the system (5) for 
7¥#0,(38+27)(c-a—y7)#landa=£8 + 24. 


2. Use the linear transformation following Theorem 1 to reduce the sys- 
tein (1) with + = 0, a = 2 and f(c — a) # 1 to the systein (3) with 
bo2 = 0 and show that on the center manifold, u = —ay2v? + 0(v*). 
of (3) we have a flow determined by » = —v* + 0(v*), after an ap- 
propriate rescaling of time. And then, using the same linear trans- 
formation (and rescaling the time), show that the flow on the cen- 
ter manifold of the system obtamed from (6) is determined by ¢ = 
py + pov — v? + O(pyv. 2. 2. u4,...). Cf. equation (16) and Prob- 
lem 6(b) in Section 4.3. 


3. Show that under the linear transformation of coordinates xx = (u — 
v)/(ac — a? — 1), y = (c — a)u/(ac — a? — 1), the systein (1) with 
7 = 0,a £ (3. B(c — a) = 1 and f F# 2c reduces to 
i= v+au? + buv 
b= u? + euv 
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4. 


with a = (c? — ac — 1)/(ac — a? — 1) and b =e = 1/(ac — a? - 1) 
and note that e+ 2a = —(1 — 2c? + 2ac)/(a? — ac+1) £ 0 iff 
(1 — 2c? + 2ac) # 0 or equivalently iff 8 4 2c. As in Remark 1 in 
Section 2.13, the normal form (1) in Section 4.13 results from any 
system of the above form if e + 2a # 0 and, as was shown by Takens 
[44] and Bogdanov [45], the universal unfolding of that normal form is 
given by (2) in Section 4.13; and this leads to the universal unfolding 
(7) of the system (1) in Theorein 3. 


(a) Use the results of Theorem 4 (or Problem 8b) in Section 4.4 to 
show that the system 


&= pr—yta?+cry 
y=rtpytsr? +mzry 


has a weak focus of multiplicity 2 for ~ = 0 and m = -1. 
(Also, note that from Theorem 4 in Section 4.4, W2 = -—8 < 0 
for p = 0, m = -1, n = 0 and a = b = & = 1.) Show that 
this system defines a family of negatively rotated vector fields 
with parameter p in a neighborhood of the origin and use the 
results of Section 4.6 and Theorem 2 in Section 4.1 to establish 
that this system has a bifurcation set in a neighborhood of the 
point (0, —1) in the (s,m) plane given by the bifurcation set in 
Figure 2 above (the orientations and stabilities being opposite 
those in Figure 2.) 


(b) In the case of a perturbed system with a weak focus of multi- 
plicity 2 such as the one in Example 3 of Section 4.4, 


: 16 
£=y — ela + azz? + =" 


y= -2, 


(where we have set as = 16/5) we can be more specific about 
the shape of the bifurcation curve C2 near the origin in Figure 2: 
For = a3 = 0, use equation (3’) in Section 4.4 to show that 
this system has a weak focus at the origin of multiplicity m > 2 
and note that by Theorem 5 in Section 3.8, the multiplicity 
m < 2. Also, show that for up = a3 = 0 and ¢ > 0, the origin 
is a stable focus since * < 0 for x # 0. For p = 0, € > O and 
a; % 0, use equation (3’) in Section 4.4 to find o. Then show 
that for ¢ > 0 this system defines a system of negatively rotated 
vector fields (mod xz = 0) with parameter p and use the results 
of Section 4.6 and Theorem 2 in Section 4.1 to establish that 
this system has a bifurcation set in a neighborhood of the origin 
in the (4,a3) plane given by the bifurcation set in Figure 2 
above (the stabilities of the limit cycles being opposite those 


540 4. Nonlinear Systems: Bifurcation Theory 


in Figure 2). Finally, show that the Melnikov function for this 
system is given by 


M (a, 2) = —na?(p+ =a3a? + 2a*) 


and, using Theorem 2 in Section 4.10, deduce that for sufficiently 
small ¢ > 0 this systein has a multiplicity-2 limit cycle in an 
O(e) neighborhood of the circle of radius r = (/y/2 iff ag = 
—8,/2:/3; i.e., the bifurcation curve C2 in Figure 2 above is 
given by a3 = —8,/24/3+O(e) for sufficiently small ¢ > 0 in this 
system. Note that the curve a3 = —4,/p for which the system 
in Example 3 in Section 4.4 has two limit cycles asymptotic to 
circles of radiir = “ji andr = {2/4 as € — O, lies in the region 
bounded by the curve C2 and the a3 axis where this system has 
two limit cycles. 


Research Problems 


We list the major research problems that remain to be solved in order to 
complete our understanding of the dynamics in the class of BQS. These 
are essentially the same open problems that were listed at the end of our 
paper [60]. 


1. Complete the study of the finite codimension bifurcations that occur 
in the class of BQS, i.e., those bifurcations discussed in Remarks 2 
and 3 above. 


2. Prove that any BQS has at most two limit cycles, i.e., solve Hilbert’s 
16th Problem for BQS. 


3. Completely describe the dynamics in the class of BQS. One approach 
to this problem would be to complete the solution of Coppel’s prob- 
lem for BQS3 by first solving Research Problem 2 above and then 
completing the description of how the bifurcation surfaces described 
in Sections 4.14 and 4.15 partition the parameter space for the BQS 
(1), with @ < 0 and ¥ > 0, into components (as well as determining 
which phase portrait in Figure 8 of the previous section corresponds 
to each component.) 
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This textbook presents a systematic study of the qualitative and geo- 
metric theory of nonlinear differential equations and dynamical systems. 


Although the main topic of the book is the local and global behavior of 
nonlinear systems and their bifurcations, a thorough treatment of linear 
systems is given at the beginning of the text. All the material necessary 
for a clear understanding of the qualitative behavior of dynamical sys- 
tems is contained in this textbook, including an outline of the proof and 
examples illustrating the proof of the Hartman-—Grobman theorem, the 
use of the Poincaré map in the theory of limit cycles, the theory of rotated 
vector fields and its use in the study of limit cycles and homoclinic loops, 
and a description of the behavior and termination of one-parameter fam- 
ilies of limit cycles. 


In addition to minor corrections and updates throughout, this new edi- 
tion contains materials on higher order Melnikov functions and the 
bifurcation of limit cycles for planar systems of differential equations, 
including new sections on Francoise’s algorithm for higher order Melnikov 
functions and on the finite codimension bifurcations that occur in the 
class of bounded quadratic systems. 
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